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From the preface to the first edition 


This book constitutes an attempt to present in a connected fashion 
some of the most important numerical methods for the solution of 
ordinary and partial differential equations. The field to be covered is 
extremely wide, and it is clear that the present treatment cannot be 
remotely exhaustive; in particular, for partial differential equations it 
has only been possible to present the basic ideas, and many of the 
methods developed extensively by workers in applied fields — hydro- 
dynamics, aerodynamics, etc. —, most of which have been developed 
for specific problems, have had to be dismissed with little more than a 
reference to the literature. 

However, the aim of the book is not so much to reproduce these 
special methods, their corresponding computing schemes, etc., as to 
acquaint a wide circle of engineers, physicists and mathematicians with 
the general methods, and to show with the aid of numerous worked 
examples that an idea of the quantitative behaviour of the solution of 
a differential equation problem can be obtained by numerical means 
with nothing like the trouble and labour that widespread prejudice 
would suggest. This prejudice may be partly due to the kind of mathe- 
matical instruction given in technical colleges and universities, in which, 
although the theory of differential equations is dealt with in detail, 
numerical methods are gone into only briefly. I have always observed 
that graduate mathematicians and physicists are very well acquainted 
with theoretical results, but have no knowledge of the simplest approx1- 
mate methods. If approximate methods were more well known, perhaps 
many problems would be solved with their aid which hitherto have 
simply not been tackled, despite the fact that interest in their solution 
has existed throughout. Especially with partial differential equations 
it has been the practice in many applied fields to restrict attention to 
the simplest cases — sometimes even to the cases for which the solution 
can be obtained in closed form —, while advancing technology demands 
the treatment of ever more complex problems. Further, considerable 
effort has often been put into the linearization of problems, because of 
a diffidence in tackling non-linear problems directly ; many approximate 
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methods are, however, immediately applicable also to non-linear prob- 
lems, though clearly heavier computation is only to be expected; 
nevertheless, it is my belief that there will be a great increase in the 
importance of non-linear problems in the future. 

As yet, the numerical treatment of differential equations has been 
investigated far too little, both in theoretical and practical respects, and 
approximate methods need to be tried out to a far greater extent than 
hitherto; this is especially true of partial differential equations and non- 
linear problems. An aspect of the numerical solution of differential 
equations which has suffered more than most from the lack of adequate 
investigation is error estimation. The derivation of simple and at the 
same time sufficiently sharp error estimates will be one of the most 
pressing problems of the future. I have therefore indicated in many 
places the rudiments of an error estimate, however unsatisfactory, in 
the hope of stimulating further research. Indeed, in this respect the 
book can only be regarded as an introduction. 

Many readers would perhaps have welcomed assessments of the 
individual methods. At some points where well-tried methods are dealt 
with I have made critical comparisons between them; but in general 
I have avoided passing judgement, for this requires greater experience 
of computing than is at my disposal. 


Hannover, December 1950 
LOTHAR COLLATZ 


From the preface to the second edition 


In this new edition I have incorporated, so far as they have been 
accessible to me, the advances which have been made since the publica- 
tion of the first edition. With the intense active interest which is now 
being taken in the numerical solution of differential equations the world 
over, new results are being obtained in a gratifyingly large number of 
topics. I always welcome especially the derivation of new error esti- 
mates, and in the present edition I have in fact been able to include 
error estimates with a large number of examples for which not even the 
rudiments of an error estimate were given in the first edition. May 
such further progress be made that in the future an error estimate will 
be included as a matter of course in the numerical treatment of any 
differential equation of a reasonable degree of complexity. 

In spite of the fact that the book has been allowed to expand, 
considerable care has been necessary in choosing what extra material 
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should be taken in; with such a large field to cover it is hardly possible 
to achieve completeness. It is certain that many readers will notice the 
omission of something which in their opinion ought to have been in- 
cluded. In such cases I am always grateful for criticism and interesting 
suggestions. 

My very especial thanks are due to Dr. JOHANN SCHRODER, Dr. 
JuLivs ALBRECHT and Dr. Hermut Bartscu, who have inspected the 
proof-sheets with great care and in doing so have made numerous 
valuable suggestions for improvement. 


Hamburg, Summer 1954 
LOTHAR COLLATZ 


Preface to the third edition 


This English edition was translated from the second German edition 
by Mr. P. G. Wixitams, B.Sc., Mathematics Division, National Physical 
Laboratory, Teddington, England. It differs in detail from the second 
edition in that throughout the book a large number of minor improve- 
ments, alterations and additions have been made and numerous further 
references to the literature included; also new worked examples have 
been incorporated. Mr. WILLIAMS has made a series of suggestions for 
improving the presentation, which I gratefully acknowledge. My especial 
thanks are due to him, to his wife, Mrs. MARION WILLIAMS, and to my 
assistant, Dr. Prier Kocu, for the proof-reading, and also to Springer- 
Verlag for their continued ready compliance with all my wishes. 


Hamburg, Summer 1959 
LOTHAR COLLATZ 
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Chapter I 


Mathematical preliminaries 
and some general principles 


In this chapter we collect together some mathematical results which will be 
needed later and state some general approximation principles which are applicable 
in all the following chapters. 


Some notes on the numerical examples 


1. The numerical examples will be used solely for illustrating the 
methods. Consequently it is sufficient in many cases to exhibit only 
the early stages of the computation and it is permissible to simplify 
the calculations by using a rather large finite-difference interval or by 
retaining only a few terms in a Ritz approximation, etc. The results 
obtained with such simplifications are often quite crude, but it should 
be borne in mind that their accuracy can always be improved by using 
a smaller interval or taking in more terms as the case may be (to save 
space this will not be stated explicitly in each individual case). The 
explanatory treatment of the examples in the text should enable the 
reader to effect such improvement in accuracy without difficulty, though 
this may not be necessary in many cases; in technical applications, for 
instance, quite a low accuracy, permitting an error of several per cent 
maybe, is often quite sufficient. 

2. To study accuracy I have computed the results of many of the 
examples to more significant figures than are given in the tables and 
elsewhere. These are rounded values and hence anyone who works 
through an example with the number of significant figures given is 
liable to arrive at a slightly different result. 

3. One should be wary of drawing general conclusions as to the ment 
or demerit of a method on the basis of individual examples, for a great deal 
of experience is needed before a sound assessment can be made. Furthermore, 
the efficacy of a method is strongly dependent on the computing tech- 
nique of the individual, the degree to which he is accustomed to the 
method, the resources at his disposal, and many other factors. 

4. Several important checks are mentioned in the text. However, 
the numerous checks which were, in fact, always applied during the 
calculation of the examples are generally not reproduced in the interests 

Collatz, Numerical treatment, 3rd edit., 2nd print. 1 
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of economy of space. In carrying out a computation, whether for a new 
problem or as a check on results already calculated, one should apply as 
many current checks as possible; the beginner usually regards checks as 
superfluous until he makes a deep-rooted mistake whose location and 
correction takes longer than a proper computation carried out with 
current checks. One should beware the hasty calculation and heed the 
well-known proverb: “More haste, less speed.” 

Of course, a study of possible checking techniques 1s a necessary pre- 
liminary. For any calculation it is important to consider how one can 
control effectively which sources of error shall be present and how suitable 
checks can be kept on the errors arising from these sources. Only when 
sufficient checks have been satisfied to inspire confidence in the accuracy 
of the calculation up to the current point should one proceed further. Even 
though checks have been satisfied, it is still possible that the calculation 
may have gone astray; the experienced computer knows that he can 
never be too suspicious of the calculation in hand. Whenever possible 
the results should be confirmed by a second calculation based on a 
different method or by a recalculation performed by another person. 


5. Elementary calculations such as the solution of algebraic equations 
or systems of linear equations and the evaluation of elementary integrals 
have been omitted. Hence the actual work involved in a calculation 
is often considerably greater than a glance at the printed reproduction 
would suggest and the reader is warned not to be misled by this. 


§1. Introduction to problems involving differential equations 


1.1. Initial-value and boundary-value problems in ordinary 
differential equations 


The general solution of an n-th order differential equation 


F(x, y (x), 9'(x), 9'(2), --, ¥(x)) = (1.1) 


for a real function y(x) normally depends on » parameters ¢,,..., Cy. 


In an initial-value problem these parameters are determined by pre- 
scribing the values 


y) = y") (x) (v =0,1,2,...,% —4) (4.2) 


at a fixed point x= x9. If the conditions are based on more than one 
point x, then the problem is called a boundary-value problem. The 
“boundary conditions” can have the form 


(n—1 


VRQ cy sso 


c — => 
ies Vey» CDSE) yt » oe) Veg» Veg» be vy =) = ‘ha 3) 


(veS0) ::, 8 ="), 
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where the x,(%;<%,<+:-<4x,, say) are prescribed points which may 
include + oo and the ye) denote the values of the o-th derivative of 
y(x) at the points x= x,: 
de 
you(Fr) 


dxe@ 


F and V, are given functions which, in general, will be non-linear. To 
solve the ““boundary-value problem” (1.1), (4.3) is to find that function 
y (x) which satisfies equations (1.1) and (1.3). The boundary conditions 
need not be restricted to the form (4.3); for instance, we can impose 
a condition such as 


Ne, 9 (x), 2 = (ax — 0, (1.4) 


where V is a prescribed integrable function. 


Depending on the functions F and V,, such a boundary-value problem may 
have no solutions, one solution, several solutions or even infinitely many; for 
example, the problem 


¥+y=0; y(0)=y(n)=1 
has no solution and the problem 
Mien y=0; yOyet yr) 1 
has infinitely many solutions. 

Further, as an example in which the length of the range of integration is an 
additional unknown, we mention the gunnery problem in which, for a fixed muzzle 
velocity v,, the angle of elevation #, is to be determined so as to hit a given target. 
If the projectile has unit mass and for simplicity the problem is assumed to be 


two-dimensional, then the co-ordinates of the projectile after a time ¢ satisfy the 
fourth-order system of differential equations 


¥=—weos?, y= —wsind—g(y). 


Here, dots denote differentiation with respect to time, the acceleration g due to 
gravity is a given function of the height y, the air resistance w is a given function 
of height and projectile velocity, and the angle between the trajectory and the 
horizontal is denoted by #=tan !(dy/dx). With the firing point as the origin of 
the co-ordinates and (%,, y,) as the co-ordinates of the target we have (corresponding 
to the four constants of integration and the unknown time of flight f,) the five 
boundary conditions 

t#=0: *=0, y=0, #74 f2 = 05; 

t=t: #*#=%, YVrI- 


Note that in the condition ##+ y?= ve we have a non-linear boundary condition. 


1,2. Linear boundary-value problems 


We shall deal in greater detail with the special class of boundary- 
value problems for which the differential equation and the boundary con- 


ditions are linear (these are called linear boundary-value problems) and 
1* 
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for which the boundary conditions are based on only two points, say 
x,=a and x,=b, where a<b. The differential equation may be written 


in the form 
L{y] =r(x), (4.5) 


where 
Liyl= Lh =heay they thay +--+, (1-6) 


and similarly the boundary conditions (assumed to be linearly inde- 
pendent) may be written 


Uly]=y (%=1,2,...,%), (1.7) 
where at 
Uy] = 2 (%,. y" (a) + B, 29” (0). (1.8) 


The /,(x) and r(x) are given functions which we normally assume to 
be continuous and the y,, a, ,, 8, , are given constants. 

The differential equation is called homogeneous when r(x) =0 in the 
interval axx<b and otherwise inhomogeneous; similarly a boundary 
condition is called homogeneous when the y, associated with it are zero and 
otherwise inhomogeneous. The boundary-value problem is called homo- 
geneous when the differential equation and all the boundary conditions are 
homogeneous. 

When the differential equation 1s of even order n =2m, the boundary 
conditions can be divided into ‘‘essential’’ and ‘‘suppressible’’? (the senses 
in which they are essential or suppressible, respectively, will be explained 
in Ch. III §§ 5,6 when we deal with Ritz’s method). As many as possible 
linearly independent linear combinations of the 2m given boundary con- 
ditions (1.7) ave formed such that derivatives of the m-th and higher orders 
are removed. By this process, k (say) linearly independent boundary 
conditions are obtained which contain only derivatives of up to the (m —1)-th 
order. These are called ‘‘essential’’ boundary conditions. A further 2m —k 


1 Following E. KaMKE: Math. Z. 48, 67—100 (1942), who called the two types 
of boundary condition ‘‘wesentlich’’ and ‘‘restlich’’. BrezENO-GRAMMEL: Tech- 
nische Dynamik, Vol. I, 2nd ed., p. 136, Berlin 1953, uses a different terminology; 
from mechanical ideas he derives the terms ‘‘geometrische’’ and ‘‘dynamische’’ for 
boundary conditions in second- and fourth-order problems corresponding to our 
“essential’’ and “‘suppressible’’, respectively. 


For special problems the following distinctions are also found in the literature: 


For differential equations of the second order (m-== 1) one calls the conditions 


y (a) =«, y ae =f boundary conditions of the first kind, 
BV (ON ed, ‘(b)=6 boundary conditions of the second kind, 
6, ¥ (a) +c, y'(a)=a, dyy(b home (o)}=P boundary conditions of the third kind or 


(where |c,| + |c¢,|>0and|d,|+|d@,|>0) sometimes SturM’s boundary conditions. 
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boundary conditions, which may be termed ‘‘suppressible’”’, can be specified 
such that no more “essential” boundary conditions can be obtained from 
them by linear combination and such that the combined ‘‘essential’ and 
“‘suppressible” boundary conditions are equivalent to the original system 
of 2m boundary conditions. 

For example, if the boundary conditions y(0)+ y’(1)=41, y(1)+ 
2¥'(1) =3 are given with a second-order differential equation (m= 1), 
they can be combined linearly to give the new boundary condition 
2y(0)—y(1)=—1 in which the first derivative no longer appears. 
No more linear combinations of these boundary conditions can be found 
which contain no derivatives and hence we have one “essential” 
boundary condition 2 y (0) — y(1) = —4 and one “‘suppressible’’ boundary 
condition, say (0) + y’(1) =14. 

A homogeneous boundary-value problem (sometimes called com- 
pletely homogeneous) will usually possess only the trivial solution 
y (x) =0. One therefore considers those problems in which a parameter 
A occurs, either in the differential equation or in the boundary conditions, 
and investigates the values of A, the so-called ‘‘eigenvalues’’, for which 
the boundary-value problem has a “non-trivial” solution, i.e. a solution 
which does not vanish identically. Such a solution is called an eigen- 
function and the whole problem is called an “eigenvalue problem” 
(see Example III in § 1.2 of Ch. III and also § 8 of that chapter). 


1.3. Problems in partial differential equations 


Examples of initial-value and boundary-value problems in partial 
differential equations which will acquaint the reader with the types of 
problems that arise will be found in Ch. IV, §1 and Ch.V, §1. In this 
section we go directly to the general formulation and pose the problem 
of determining a function “(x,, %2,..., %,) of m independent variables 
which satisfies a partial differential equation 


ee eis, 32.6) Bisse Mens s-) =O mB (1.9) 
and certain boundary conditions 
Mee, 20 y ae ter ey) <2 My ys =225 Mags ess) =O ond). (1.40) 


The subscripts on # denote partial differentiation with respect to the x,; 
for example, 


Ou ou 
_——— ——. . =—_— —— —a ; i | 
Ox, : “ih Ox; Ox, ( ) 
B is a given region of the (x,,..., %,) space, the I, are (m — 1)-dimen- 


sional ‘‘hyper-surfaces”’ of this space and F and the V,, are given func- 
tions which will be assumed to be continuous. 
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Here also the linear problems play a special rdle. A partial differential 
equation is said to be linear when it is linear in u and the derivatives 
of u, i.e. when it has the form 

Oy oe ban 
Liul=e >) ee {os ee 


1 Op a an 
te +OnSm Oxy"... O%_ 


where the A, a,,..,a, and 7 are given functions of x,,...,%, and m is 
the order of the differential equation (in so far as a derivative of the 
m-th order actually appears). As with ordinary differential equations 
the terms homogeneous and inhomogeneous are applied to the equations 
with r=0 and 70, respectively. 

A partial differential equation is called quasi-linear when it is linear 
in the highest order derivatives occurring (say of the m-th order), i.e. 
when it has the form 


gritos toen ay 
CE a. 
Hyter+a,=—m 7 Ox? one Oxe 
where 7 and the A, ,,, are now given functions of x,,..., x,, “ and 


partial derivatives of « of up to and including the (#—41)-th order. 
If the boundary conditions are linear, i.e. linear in » and its partial 
derivatives, then we write them in the form 


Oy Cea ee nee ne ps eee at: (1.13) 
on I’ (#i— le. ee 


u 
where the y, are given functions of position on the J), and U, is linear 
and homogeneous in w and its derivatives. Again we say the boundary 
conditions are homogeneous when y,,= 0 and inhomogeneous when y,, + 0. 
A boundary-value problem is termed linear when the differential 
equation and all the boundary conditions are linear. Any linear bound- 
ary-value problem can be reduced to one in which either the differential 
equation or the boundary conditions (which should not be self-contra- 
dictory, of course) are homogeneous. This is achieved by introducing 
a new function u*=«— 4%, where u#, is a function satisfying either the 
inhomogeneous differential equation or the inhomogeneous boundary 
conditions, respectively. 


§2. Finite differences and interpolation formulae 


We assume here that the reader is familiar with the foundations of 
the calculus of finite differences so that we may be brief. 


2.1. Difference operators and interpolation formulae 
Suppose that we know the values /,=/(x,) of a function /(x) at the 
(N +1) equidistant points x,= 4% )+vh, where »=0, 1, 2,..., N (some- 
times y may be non-integral). 4 is variously called the interval of 
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tabulation, pivotal interval, step size, or just the interval and is always 
taken to be positive. For any function F(x) we can define the difference 
operators 4, V, 6 for the interval / as follows: 


AF (x) = F(x + h) — F(x), 
V F(x) = F(x) — F(x —h), 


OF (x) = F(x + $h) — F(x —#h); 
we call 


Af.=fiui—fh forward differences, 
Vie fy — fea backward differences, 
and 


Of, = feiy —fp-3 central differences. 
Each of these may be extended to higher differences; thus, for example, 
A?f, = A(4f,) =A hai —h) = hiepa — 2h tis 
and in general 
APf,=A(A?f,), VPA=VVP Ff), Pf, =S(0P*f,)  (P=1,2,3,...). 
To extend these definitions to #=0 we write 
A°f, =V° fp = Of, = fh 


For the general non-central differences we have 
p p 
, p 
Ae, = Gaal esto» VP.= Ds (—1)2 (7) ae 


e=0 
The “first” (p=1) and “higher” (p>41) differences are often con- 
veniently written down in the “‘difference table’ of the function f(x) 
in which the difference of two entries appears opposite the gap between 
them as in Table I/1. 


Table 1/1. The ‘‘sloping’’ difference table of a function f(x) 


| 


First | Second Third differences 


| vt 
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Occasionally, however, it is more convenient to write the differences 
Vt, (b=0,1,2,3,...) with the same & all on the same line as in 


Table I/2. 
Table 1/2. The “horizontal” difference table of f(x) 


differences 


In the theory of interpolation, polynomials are derived having the 
property that they coincide with the function /(x) at certain points x,; 
we reproduce here only those polynomials which will be used later. 


With the abbreviation u = a—** “NEWTON'S interpolation polynomial 
with backward differences” can be written 


N,(*) =fot+ “Vip + 2%+ prj. + |. : 
| . 


+ 2) 4 4 
ae he V* fo bs. - <a 7 geo ea aay; 
it takes the values of /(x) at the points x), *,...,_,. There is a 
point x = inside the smallest interval of the x axis containing the points 
%, Xo, X4,..., Xp, Such that the remainder term at non-tabular points 
is given by? 
R = — N(x) — Bet 1). (4+ 0) ptr ape (ey 
p-+1(%) (x) » (x) era f (§) (2.2) 


The corresponding Newtonian interpolation formula with forward dif- 
ferences is 


NF (4) = fo + He Aly + Atty +--+ () APfo + |, | 
| oy 


sy Nee (é). 


STIRLING’S interpolation polynomial, which we write down only for 
even #, is 


Sty (2) fy se Leal go EN appa At) Ra ae 


3! 2 
2 2.4) 
— an i whos 2 sone ( 
eee, oa . ai) ae 


1 For the whole of this section see, for example, G. SCHULZ: Formelsammlung 
zur praktischen Mathematik. Sammlung Gdéschen, Vol. 1110. Leipzig and Berlin 
1945; and Fr. A. WILLERS: Methoden der praktischen Analysis, 2nd ed. Berlin 
1950, particularly p. 76 et seq. 
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it coincides with f(x) at the points x_pj, ..., X41, %, %1, --», Xp and the 
remainder term at other points is given by 


u+ “2 
Ry 41 (2) = f(x) — Stp(2) = ( ~~ Jansson (é). 


From STIRLING’s polynomial we can obtain a symmetric formula! whose 
remainder term is of higher order: 


cd a 2 
2! 4! 


24 
PR gil (2.5) 
u?(u?—1)...(w?— |— -4 
+ ( ( ere 
where (ey) 
u®(u? — 1)...(u® — | — 
ee _ < P+2 Hp+2) 
_ (p + 2)! peprinwas : 


2.2. Some integration formulae which will be needed later 


From the polynomials of the preceding section we can obtain for- 
mulae for the approximate integration of f(x) over specified intervals 
by replacing f(x) by one of these polynomials in the required interval. 
Thus by integrating NEwWTOoN’s interpolation formula (2.1), (2.2) with 
respect to x over the interval x) to %)+h we obtain 


Xeth 
fieax=hlot+ 0+ 30+ 20% fo+--]+ 
Xeth p (2.6) 
a f Rosa ax =h >) BV fy + Spit: 
ae end 
where 


1 
Bo=—; f w(w+1)...(¢+e—1)du (=A) (2.7) 
0 
The first few B, are 


1 5 3 2251 =e, OE _ 19087 
Bo=1, a>: Bs —, B=: Die 720° B= ae Be = 60480 ° 


For S,,, we have the estimate 


Xoth | 


ISp4a] = if SOE DEED) ppt fos (8) dx 


(2.8) 


|Xo 


WPT? Bay | fP +) ae 


1 STEFFENSEN, J. F.: Interpolation, p. 29. Baltimore 1927. 
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If we replace /(x) by the Newtonian polynomial based on the points 
1, Xo» 1 +++, ¥ p41, Le. the polynomial 


fee 2h | Pay eee ake 


then integration over the interval x) to %)»+ A gives 


Xoth 
fiede=nlh—-t0h-2Vh- Zh | + $a 
: p 
SS h 2 Be Ves, ale Shia (2.9) 
e= 


1 


By = : f (4) uu +1)... +e —2) du. 


where 


The first few Bf are 


ees en ee ia ai ee ee 
Bo 1, Br Ry » Be 42’ Bs PY © a 720’ 
pr = — 3) * _ 863 
: 160 ’ ¢ 60480 


An estimate for S}., is given by 


| Xo+h 
(u — 1) u(m+1)...(u+p—1) porn psa sy 
/ (p +1)! i (2.10) 


[SF 4 = 


\to 


2 her?) Beal |itPehier. 


If we apply (2.9) to the function ‘) (x)==f(2%,+h—«x}, we obtain 


Xoth Xyth 
JS i)dx= ee pth —a)dx— AS BP (—1)0P ft Spyy 
i“ aa (2.14) 


1 ~ 
= VA —BAV et +) + Spas 


with a corresponding form for the remainder term s, ae 


The f, and B¥ are connected by the relation 


Bo + Bi1=Byar1 (9 =0,1,2,...), (2.12) 


: | | 1 
By + Bess = ee ee ie Te Fe aman 
0 


for 
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By adding equations (2.12) for 9=0,1,2,...,p—4, together with 
Bo= Be (=1), we obtain the relation 


p 
Pe = Bp. (2.13) 


Integration of STIRLING’s formula (2.5) over the interval x)—~h to 
Xo+h gives 


Xoth 
1 1 1 
Xy—h on (2.14) 
=e V2e 7 +Sé*, 
=0 
where ; 


1 
2 
ee aar | #e—) (u?— 4)... (w®@— (9 —1)*)du. (2.15) 
0 
An upper bound for the magnitude of the remainder term is 


[Set] SPT? BS" [FP lax: (2.16) 
lees 


For p =2 (2.14) reduces to Simpson’s rule 


Keth 


fi@)ax=h2p+ +A 4. SH, (2.47) 
X—h 
where 
5 : 
|St*|S [Pjur (2.18) 


2.3, Repeated integration 


If we integrate NEwrTon’s interpolation formula (2.1), (2.2) over the 
interval x, to x (x= %,+wh), we obtain the indefinite integral 


fey dx = hf Ny led) du + f Rysrde='1(4) Te) 


e 
3u? + 213 


= h|wfo+ Viet Cen Pore |e oe 


and a second integration gives 


ff He) (42° ="F (2) —"Hee) — Flt) (0 — 2) 


AB (2.20) 


=H fy + "Wty + ++] + Ra, pa 
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where 'f is an indefinite integral of /(x) (=F), ’/ is a indefinite second 
integral of #(x) and in general ”/ denotes a y-th repeated indefinite 
integral of f(x) or, shortly, a »-th integral of f(x), so that 
x 
Oy Oa el 2 Seite) (2.21) 
Similarly we define (with Ry ,4:= Ry +1) 


Ry p= pt te = 1,2,3,--.)- (2.22) 


By further integrations we obtain the general n-th integral 


n—1 


fof Fax)" = f(x) — "\# (x9) =| 
% Xo P v=0 (2.23) 
=I DP, (u) V%fy + Rp, 941 (2), 


g=0 


where the P, ,(u) are defined by the m-th integrals 


ne — a f ie tens (du)” for o=1 


(2.24) 
P, os) =<" (n =4,2,...). 
For small and @ the P, , have already been exhibited as polynomials 


in « in the formulae (2. 19), (2.20) above; the polynomials for several 
higher values of m and @ are given in Table 1/3. 


Table 1/3. The polynomials P, , () 


met} ou | Sut] % (3utt2ou8)| 2 (4u2+4udtus) pao (9042+ 11008445 uh +6.u8) 
Nn=2 2 ue? ; u3 x (2uS+ 14) 260 (208 +15 u4+3 ud) 40 (6045+ 55 u4+18u5+2 u8) 
m=3| gu | Sud | st (Suttons) | 25 (10ut+6ubsus) 92, (105ut+77 ud 421 wo4 207) 
n=4 a ua iio us 330 (3 5+ 18) eue (14 u5+7 48447) 


The value of the n-th indefinite integral (2.23) when x= 4%, is 


Ff fraser) Sra s 


Xs Xo Xo > yan O (2.25) 
=H" D Bae V?fot Ru, p41 (%), 
e=0 
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where the aia By, denote the numbers 


=f f- fteenecea ere: a UF OT 4) du)" =P, (1). (2.26) 


These mene B,,o include the numbers £, of (2.7) as the special case 
n=1, 1. B,=8B,,. The first few £,, are given in Table I/4. From 
(2.2) and (2.26) we see that an estimate for the remainder term in 
(2.25) is given by 


| Rn, p+2(%)| S Bp, perth Ort fP 4 | as (2.27) 


Table 1/4. The numbers B, , 


32 
41 
2016 


89 
24192 


5849 
181440 


| ale tol 


If we take the upper limit in (2.25) to be x_, instead of x,, we obtain 


foe faa = F(x 4) — TPF (xq) 


y=0 


; (2.28) 
Si et ett >» VuoV® fot Rn, p41(%—a)) 
where ie 
yaa ff - fl “+e "ayy | 
(2.29) 


=f f- ft =(—1)"te@P (—14). | 


The first few numbers y, , are given in Table I/5. 


Table I/5. The numbers yy , 
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Clearly we can also obtain these numbers by integrating NEWTON’S 
formula (2.3) with forward differences: 


te J fadayt = f(x) — Sg) 


Hy 40 P v=0 . (2.30) 
= ye AY, S- 
o=0 


An estimate for the remainder term S can easily be derived by integra- 
tion of the remainder term in (2.3): 


[S| SH Yn, psa] [FPP max: (2.34) 
In addition to the coefficients introduced already we shall need the 
quantities By, which are obtained in the same way as the f,,, except 


that the lower limit %, in (2.19) to (2.26) is replaced by x_,. Performing 
the individual ee ee afresh, we obtain 


ine dx =h J M(x) Paes a) — fla) 
Pa ra (2.32) 


= hl (w+ 1) fot “E* Vfyt EASE" prj +) + RE par, 


(d aes —_ ze Led, Pie ae 
J fran x)? = "t (x) — "FP (%-4) — "fF (%) (® — 24) ge 


us — = 
“eae ay eeY = 2 ++-|+ Ripe 


and weal for Pa 


fof near 109 —Se-yeeg 39" 


v=0 


=h" > PS, (t) Vfo t+ RE pa1(2), 


e=0 
where the polynomials Five are given by the -th indefinite integrals 


Hes Ce f es : (d@u)" for 9=1 


P*,(u) = mens (tere) Ce ica) 


Table I/6 gives the polynomials P*, for a few values of 7 and 9. For 
%=X_ (2.34) becomes 


S-fnear == Dey 2 


(2.35) 


; (2.36) 
= " Dos eV fo + Re, p41 (%)- 
o=0 
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Table I/6. The polynomials Px ,(u) 


(243 -+.3 42-1) 
at (u4+2u3—2u—1) 
n=3] | (u+1)9 | sa (M4628 u—3) sae (2u5+5 u4§—10u?—10u—3) 
n=4 Aa | sa (81008200215 u—4) | 2 (uo 308100815 u2—9u—2) 


n=1 palate 1) Fan (64F+45 ut+ 110u3+90u?2—-19) 
n=2 3a6" (345+415 u*+20u3—15 u—7) sus ae Gear Geren ae 
n=3 7 (u8+6u5+10u4—15 u2—14.4—4) Soa) 
n=4 Sead (u7 +7 u8+14u®§—35 uw38—49 u2-28 u—6) 


Corresponding to (2.22) and (2.26) we have 


x 


Rrev=JRiapdx (v= 1,2,3,...) (2.37) 


1 


pan f fnflete'jear exe 


Bes (2.38) 
yo! 
Br o— mal ‘ 
Here also the coefficients Bf, contain the numbers f} of (2.9) as the 


special case m= 1 since B¥ =f ,. The first few Bx , are given in Table I/7. 
Exactly as in (2.12) it can be shown that 


Bro+ Br ott=Bneti (9=0,1,2,...) (2 =1,2,3,...). (2.39) 
By adding equations (2.39) for g=0,1,2,...,f—1, together with 
B,,0=Bn0(= “ae we obtain a generalized form of (2.13), namely 


p 
* 
= D) 
21 Bn, o = Bn, p (2.40) 
e=0 
* 
Table I/7. The numbers By o 
o=0 o=1 | e=2 e=-3 | o=4 
i 1 1 | 19 
n=1 f 7a mast} a | — F0 
= 1 gel 4 | az 
oe 2 3 24 360 1440 
a 1 pare as lie — 
Le 6 8 80 180 | 3360 
1 1 1 i 83. 
a4 ‘24 ~~ 30 360 ™ (940 120960 
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From (2.2), (2.37), (2.38) we see that limits for the remainder term 
RX p41 are given by 
| Re p+1(%o)| SP *"**| BE pa] [FP 7? [max (2.41) 


Finally we derive some repeated integration formulae from STIR- 
LING’s interpolation formula (2.5). With 


D(x) =F [f (xo + wh) + f (xo — 4h)] = 3 Uf (x) + f(2% —%)] (2.42) 
we have 


[Pax =F Ut uh) — Ie 4h)] 


= h| ufo +2 0h + SS ep, + (2.43) 


28u8 — 21u5 + 3u" Le. ae 
aL as V*f,+ [-+RES. 


ff Plea)? = 5 Heo + uh) + °F (%9— 4h)] — "I (20) 


= WE + 7, + Sa me ae ae 


4 1440 


Lf f P09 = 4 07 e+ uh) —F wo 4) —"F (m9) (x = 20) 


(2.44) 


__ 23/4 ud —7u + 2u7 
st ez fot 95 Oh gga fet] + RSS, 


LL ff Plea = 5 °F e+ wh) $F (ee — why] — 
e — """HGe) — "Peg ce 


sina ut us = 44) oo 8 
=e eh + — Sage Pata, | emi 


We write down the general m-th repeated integral of ®(x) only for x= x: 


%, % od p/2 
f fof Oda)" =n" 2 Br V2c}, + R*% (x) 
*% c= 


oe i (m2). 
a [F(x9 +h) + F(x —h)] — » am a 
= (2.45) 
= for even, 
[OF (q+ A) — (x9 — Sr MeH Gag 
S Xo+ h)—"'}(x9— h)]— 2, at ’} (Xo) 
(j= 


for » odd, 
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where 
RIS = f R**, dx (2.46) 


and 
% = RF* from (2.5). 


The first few numbers 6** are given in Table I/8. 


Table 1/8. Some values of the numbers BR%, Table I/9. The numbers 1%, 
= aaa || eee ee oe a 
a t | 180 1512 
-_ i aU |e ete = ile 
n= 2 a | 24 | 480 120960 
a 2D SA aan 
Wee 6 120 | 2016 
ie |) 2 il 
eo 24 6| «6720 «| 120980 


From (2.5) an estimate for the remainder term for even # is 


net n+2 
| Re | =r me ‘Pp a)t | fe+*) eae (2.47) 


aff f *— 1) (u@—4)...(u@—(2)) (du); (2.48) 


the first few values of these numbers are given in Table I/9. 


where 


2.4. Calculation of higher derivatives 


From a differential equation 
J) = I(x, 9,9, Y") (2.49) 


we can calculate the higher derivatives y"!", y+?) ... by repeated 
differentiation (assuming that f is differentiable a sufficient number of 
times with respect to each of its arguments). Thus for the first derivative 


we have 


(n+1) —_ oF of 
y Ox zee Oy 


Of wm | 
Yee pean 


We now introduce the notation 


, 


pa, yy SM, i ee, ..., yy ccngmeeaan | , 
— ah fies ef i e2/ (2.50) 
Ou, oo Ou, OU, a. oo 


Collatz, Numerical treatment, 3rd edit., 2nd print. 2 
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and also the symbolic operator D whose operation on any function 
Q(X, Uy, M4, ---, %,_1) is defined by 


cp cp 
wet - ae aa , oe 


n-1 
CUn—2 m—1 


0 
De oo ty aa Uy 
so that 


7) 


yf . (2.52) 


For the higher derivatives it is convenient to introduce further operators 
E and F. By the operator D”) we understand the operator which results 
from formal expansion of the power 


a 7) a é ay 
(Goth ge ting tt — thay | 
treating the u, and f/ as constant factors so that they can be collected 
together as coefficients in front of each differential operator; thus, for 

example, 
ee ia —_ 
” Ox? aint: our a + naa Ou2 x» Cee as 


oe ge 
+ 2U, Ox Ou, “y+ 1 Diahiaeaia  * -+2fu,_ 1 


qe yage, 
If we now differentiate D/ with respect to x, the differentiation of the 
Of of 


derivatives Boa occurring in the individual products gives precisely 


Df; in addition there are the terms arising from the differentiation 
of the factors u, and f. Thus 


(n+2)_ 4 
yirt 9) = Di | 


x 
= De; i Ufo + Us fy a coli n_iin—a Bice ioe hrrDf = Ef, 
say, where E is the operator defined by the preceding expression. 


For a further differentiation it is expedient to derive first the formula 


4 mp =D} 4 


+ 2[t%gDfy+ ugDf, + uyDfy+---+ type) Lyep + | Dikueetad Pp - Dilggec | 


by writing down D®)f in detail and applying the operator D. Then if 
we define another operator F by 


F}=D®}+ 
+3 [u,Dfo+ usDf, Seo: +} ttgey D fgngeteD fag}, 252 (2.54) 
+ [Mejote Malar ** 4, 2ilpea a 1 aaa 


we can write 


yet) = Fi +f, Ef +f,-2Df. (2.55) 
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2.5. HERMITE’S generalization of TAYLOR’S formula 


Equations (2.57), (2.58) below constitute a generalization! of TaYLor’s 
formula; they give a relation between the derivatives of a function f(x) 
at two points a and b, where f(x) has continuous derivatives of the 
(k-+m-+-1)-th order in the interval <a, b> (k, m are non-negative in- 
tegers).. 


If g(x) = (x —a)* (x —b)™, then, by integration by parts k++ m times, 
we have 


PF x) et (x) dx = [p(x) gOE™Y (2) — F"(x) gh (a) + 
cee (— 1) mt RE (x) (x) 8 + (2.56) 
L (LANRE f fmt (4) g(a) de, 


Since g**™) (x) =(k-+m)!, the value of the integral on the left-hand 
side is 


(& + m)! (f(b) — f(a). 


It remains to calculate the values of the derivatives of g at the boundary 
points a, b. By LE1BNiz’s rule for the differentiation of a product we have 


¥ 


g(a) = > 


e=0 


(ete ate") atee—aen 


Bearing in mind that the binomial coefficients () and (, - | are Zero 


for 9>k and 9o<r—~m, respectively, we see that >) can be replaced by 
k e=0 
>» when y<k-+™m and that the sum is zero when r>k-+ m. If we now 
o=r1—m 


put x=a, only the term with @=f remains and we have 


\ 


er) = [Jar mtorr James 


similarly 
k m+k—r 
g'”) (b) =r(* | (b — ay™+*-r, 


1 Different proofs are given by S. HERMITE: CEuvres 3, 438 (1912). — Kowa- 
LEWSKI, G.: Dtsch. Math. 6, 349—351 (1942). — Osrescukorr, N.: Abh. Preuss. 
Akad. Wiss., Math.-naturw. Kl. 1940, Nr. 4, 1—20. — Prranz,E.: Z. Angew. 
Math. Mech. 28, 167—172 (1948). — Brcx, E.: Z. Angew. Math. Mech. 30, 
84—93 (1950). 
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With these values for the derivatives at the end-points and with h 
denoting the interval length b—a, (2.56) becomes 


k+m b 
(+m 10) — Ha) +] (ay Mam] 


y=1 a 
kim 


=> @tm—ie{—sy(,* mo -(™ jal 


v=0 
b 
= (— Aji | Premed x. 


m 


Still bearing in mind that (, = =0 when »y>k and ( 
y>m, we see that, after division by (k+m)!, 


k R os m 
dr Me = ao = >i (a) = is + Rm (2-57) 


with the remainder term given by 


] = 0 when 


v=0 


pa 4yh+m [ (x — a)* (x — B)™ fF (x) dx (2.58) 
hm (+m)! _ 
This result includes TAYLor’s theorem as the special case k = 0. 

When k =1 and m=2, we have the formula 
hy hy 2 ” 1 - 
(OQ -FO=KQ+SIO+ EP @PR» (2.59) 
which will be used later in Ch. II, § 1.5. 

Formula (2.57), like TAyLor’s formula, can be extended to more 
independent variables; in fact the extension can be derived using 
precisely the same device as is used for TAYLOR’s formula. For sim- 
plicity we consider the extension only for a function «(x, v) of two 
independent variables and for two points (% 9, Vo), (41, ¥,). All we have 
to do is to apply formula (2.57) to the function 


fi)=4 (xo + E(x, — Xp), Yo + e(¥1 — Yo) 


in the interval <a, b5—<0,1>; then, assuming that all derivatives 
occurring are continuous, we have 


k (") 
Mewasris i edi Ua 


Ox oy y! (" 4. 9) 
v=0 ] 
Le, 


- m 
= PE (h a o! a i ot “ es ; 7 
v=0 te, 


(2.60) 
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where h = x, — %), /= y, — yp and the symbolic notation G ‘. +1 i) 
y 


is that generally used in TAYLor’s formula!. The form of the remainder 
term R may be found from (2.58). 


§3. Further useful formulae from analysis 


3.1. GAUSS’S and GREEN’S formulae for two independent variables 


Gauss’s integral theorem in two dimensions: Let B be a closed, 
finite region of the (x, y) plane bounded by a piecewise-smooth curve 
without double points. We denote the inward normal to this boundary 
curve by »v and the arc length measured anti-clockwise from a fixed 
point on the curve by s (see Fig. I/1). If f(x,y) and g(x, y) are 
continuous functions with continuous 
first partial derivatives in B, then? 


” atle,y) _ 
ff a ea dy 
B 
(3.4) 
= — [ Hx, y) cos (y, x) ds, 
r 0 

dg (*, ¥) 
a 
B (3.2) > epee L 

= g(x, y) cos(v, y) ds. Fig. 1/1, Region, boundary curve and 


inward normal 
Te 


To apply these formulae to the differential equation 


L [wu] =r(x,9), 
where 


Eis] = — u (Ag B,) — x (Bu,+Cu)+Fu, (3.3) 


in which A, B,C, F are continuous functions with A, B,C also pos- 
sessing continuous derivatives of at least the first order, we put 


f= (4y,+ By,)@ 
in (3.4) and 
= (By, + Cy) p 


in (3.2) and add the two resulting equations (here subscripts denote 
partial differentiation, e.g. u, = du/ox). We then see that any two 


1Cf., for example, H. v. MaANGoLDT and K. Knopp: Einfiihrung in die Hohere 
Mathematik, Vol. II, 10th ed., p. 355. Stuttgart 1947. 

2 See, for instance, H. v. MANGoLpT and K. Knopp: Einfiihrung in die Héhere 
Mathematik, Vol. III, 10th ed., p. 346. Stuttgart 1948. 
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functions (x, y) and w(x, y) with continuous partial derivatives of 
up to the second order satisfy GREEN’s formula 


JIA g.y. + Blom, + pyre) + Ogpiy + F gaaliandy — om 
= Lee ty ee Lr, 


where L* is defined by 
L*[y] = (Ay, + By,) cos(y, x) + (By, + Cy,) cos(r,y)- G-5) 


If mg and y are interchanged in (3.4) and the resulting equation is sub- 
tracted from (3.4), the first integrals cancel out and we obtain the 
equation 


sy) (vL [yp] —ypL[p}) dxdy =f (pL*[y]—yL*[e])ds. (3.6) 


hy 


This is often known as GREEN’sS formula also. In the special case 
A=C=1, B=F=0, equations (3.4) and (3.6) become 


[[ Gert ov) dadyt ff oVipaxdy=—[ eas 6.7 
B B Shy 


and | : 
[f @U%~—pPrg)dxdy=— [ (eh —y las, (3.8) 


where V? is the usual symbol for LAPLAcE’s differential operator 


ep Pp 
2 = 
foe Ox? Ov 


and c/éy denotes differentiation along the inward normal: 


7) a é 
=~ = 5S cos (y, x) + 3 cos (y, y). (3.9) 


3.2. Corresponding formulae for more than two independent variables 


We also need Gauss’s integral theorem in space, say the space S,, 
of m dimensions. Let B be a closed, finite region in the (x, v9, ..., %) 
space bounded by a surface J” [an (mm —1)-dimensional hypersurface] 
which may consist of a finite number of ‘‘faces’’, each having continuous 
tangential hyperplanes. Let v be a given vector field in B with com- 
ponents'a,, a,,..., 4,,,eaeh beingla continuous fimemonion % ,.x5, .car%, 
with continuous partial derivatives of the first order. If dt =dx,dx, 
... ax,, is the volume element in B, dS the surface element on I’, + the 
inward normal to J’ and v, = (v, v) the component of v along the inward 
normal (i.c. the scalar product of v with the unit vector » directed 
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inwards from and perpendicular to I’), then Gauss’s integral theorem 


tates th 
deel f divudt = — fu,dS (3.10) 
B r 


2 ~ { Rembe nnas. (3.11) 


From this we now derive a formula which will be useful when we 
deal with the differential eet 


Li =— 9 2 (4 24) +au=r, (3.12) 


4,k=1 
where the coefficients g and 7 are continuous and the A;, have continuous 
first derivatives. If, in (3.14), we put 


a ae Ox,’ 
then, for two functions m and w with continuous second derivatives, we 
have [in the notation of (3.12) | 


finer | |—o > ia (Ase 3 3) +a0v)ax 


+ 1 


= ee PAC v4 Ain Bt) + > A,, 52 +a0ylae (3.13) 
y ae 


i.e. 


k=1 1 
~Jlo.wl+ f eL*tmies, 
ia 
where De poles 
Hewl=[( 3 428 2% +a0v)ae, 6.49) 
zs 
L*[y] = ys Aye cos (vy, x;) . (3.15) 
i,k=1 


3.3. Co-normals and boundary-value problems in elliptic 
differential equations 
If we introduce a positive number A and a direction o so that 


> A,,c0s (v, x) = Az = A cos(o, x,), 
i=1 
then (3.15) can be written 
* = ae 
L*\y) =A ae 
The half-line running from J’in the direction a is called the ‘‘co-normal’’?. 


1 See, for example, A. G. WessTER and G. SzEc6: Partielle Differential- 
gleichungen der mathematischen Physik, p. 311. Leipzig and Berlin 1930. 
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If the matrix A,, is symmetric (A;,=A,,), then, by interchanging 
g and y in (3.13) and subtracting the resulting equation from (3.13), 
we obtain GREEN’S formula 


f (Lvl —vL ig) dx = { (pL*ly] — pL*[p]) aS 


yy 


(3.16) 


In the special case 


we have A =1 and the co-normal o coincides with the inward normal . 
If, in addition, g=0, then with 


the formulae (3.13), (3.16) become 


= [evo i eeemenmens AT wS, (3.17) 
B 


B 
2 2 — —_= 
f ery —yV9)dt = {es y Lyas, (3.18) 
B 
where 0/dy denotes, in the usual way, differentiation in the direction of 
the inward normal: 
™ 


If the differential equation is of elliptic type, i.e. the matrix 4;, is 


sis 


(3.19) 


positive definite, so that for arbitrary real numbers f,, 2, ..., p,,, not 
all zero, 2 
Ors inPiP, > 0, (3.20) 


the co-normal points into the interior of the region B since the scalar 
product of the co-normal vector with the inward normal is then positive: 


>, Af cos (v, x,) = >) A;,c0s(v, x;) cos (v, x,) > 0. (3.21) 
k= ined 


Boundary conditions of the form 
A,u + A,L* [uj] = A,u+ A, As ie (3.22) 


where the A,, 4,, A, are given functions on the boundary J’, are often 
associated with differential equations of the type (3.12). In the case 


(3.4. GREEN’s functions 25 


A,=0, A= 0, the problem of determining 4 is called the first boundary- 
value problem; when 4,=0, A,-—0, it is called the second boundary- 
value problem and when neither A, nor A, are zero it is called the third 
boundary-value problem. In the case A,-+0 it is usually assumed, as 
will be done in this book, that the boundary I is piecewise smooth, 
i.e. consists of a finite number of sections I) each of which is an (m—1)- 

dimensional closed hypersurface with an (m= 2)-dimensional boundary 
I* such that the inward normal y to I} is continuous and tends to a 
definite limiting direction as any specific boundary point P on [}* i 

approached from a point inside J}. 


3.4. GREEN’S functions 


GREEN’S functions are often of great value for theoretical investiga- 
tions but they can also be used effectively for establishing formulae 
which are useful in numerical work. For ordinary differential equations 
one occasionally uses the GREEN’s function directly, but for partial 
differential equations direct application is usually avoided because the 
associated GREEN’S functions are usually either too complicated or 
even not specifiable explicitly at all. 

Let us consider the boundary-value problem (1.12), (1.13). There 
are classes of such boundary-value problems for which it may be shown 
that therevemstsra, Green's function'G (x; ..., %,,5 &, --+, &,); oF shortly 
G(x;, &;), with the following property: 


For any continuous function 7(x,,..., x,) the boundary-value prob- 
lem (4.12), (1.13) with homogeneous boundary conditions, i.e. 
tig—7, Ula) —=0, (3.23) 


is equivalent to 


1 (x5) = f G(x, 8) 116) a8). (3.24) 


Thus the boundary-value problem (3.23) may be solved with the aid 
of the GREEN’s function by means of (3.24), or in other words, a function 
calculated from (3.24) with given 7 satisfies the boundary-value problem 
(3.23). If a GREEN’S function exists, then the boundary-value problem 
(4.12), (1.43) with inhomogeneous boundary conditions is soluble, for 
it can be reduced to the case with homogeneous boundary conditions 
by the introduction of a new function u* as in § 1.3. The detailed theory 
of GREEN’s functions is covered in text books on differential equations’. 

We note here only two simple examples of GREEN’s functions which 
will be used later?. 


1 See, for example, R. Courant and D. HILBERT: Methoden der math. Physik, 
Vol. I, 2nd ed., p. 302 et seq. Berlin 1931. 

2 A short collection of GREEN’s functions can be found in L. CoLtatz: Eigen- 
wertaufgaben mit technischen Anwendungen, p. 425/426. Leipzig 1949. 
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4. The GREEN’s function for the boundary-value problem 
L{u] = —u"’=r7(x), (0) =u(l)=0 (3.25) 
is 
7-8 for x <&, 
Ce) (3.26) 


£2) loremess 


2. If ee is not an integer, then 
Liu] = —4"—nvu=r(x), 4(0)—u() =wv'(0) —u'() =0 (3.27) 


has the GREEN’s function 


, cos m(2-— E+ 2] for x<&, 
OS (3.28) 
2n sin —— cos m (2 — x+6) for x= &. 


3.5. Auxiliary formulae for the biharmonic operator 


A formula which is used repeatedly in biharmonic problems, namely 
(3.38) below, can be derived easily from (3.8). Let u,v, v be three func- 
tions of x, y (all functions mentioned here should possess derivatives 
of orders as high as occur) such that 


Vtg 7*y in B (3.29) 
and 
= ee 
“= Wei eon ‘ee (3.30) 


where the region B, boundary J° and inward normal » are as used in 
§ 3.2 and V4 is the biharmonic operator defined by 


ofu Ou otfu 
Aico 
LM oa + Aces + Gyn G34) 


If we demand further that w shall satisfy the boundary-value problem 


VAu=p(x,y) in B (3.32) 
with 
u = 7\S); i g(s) on I" (u, = =| ; (3.33) 


then v and w will be functions satisfying the differential equation and 
boundary conditions, respectively. 


Let us define 


Digi V2pV2pdxdy, D[y]=Dig,¢], (3.34) 
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for any two functions g and y. Then 


D{p + y] = D[y] + 2D[9,y] + Dy]. (3.35) 
Further from ScHWARz’s inequality we have 
(D[¢, y])? S Dlg] Diy]. (3.36) 


If we replace y by V?q in (3.8), we obtain 


Dae J) Vp Vpdxdy 


=e Vipdxdy +f (vV*9)—% V2q) ds. (3.37) 


We now calculate 
Dijvy—w)=Difv—u+u—w]=Dflv—u)+Dlu—w]+ 
+2D[v—u,u—vw)]. 


If p=v—u, p=u—w, then V4g=0 from (3.29) and p=y,=0 on I" 
from (3.30); putting these values in (3.37), we have 


D{v—u, u—w] =0. 
Hence, if u, v, w satisfy (3.29) and (3.30), 
Div — wv] = Div —4) + Diu — vw]. (3.38) 
All three terms in this equation are non-negative so that 
Divy—ujSDfv—w] and Diu—wj}SD[v—w]. (3.39) 
If the boundary-value problem (3.32), (3.33) possesses a solution u(x, y), then 


from (3.37) we can obtain a formula for the value “(%, Yo) at the point (+, Vo) 
by using the “‘fundamental”’ solution 


0(%,¥,%,%) =rInr, where v=+ Va- %)? + = Vole: (3.40) 
We have 


e 4 
0, = 3° =7(2Inr +1), V?e=eryt+ ~~ o=4(inr+1), (V29),= <, Vio=0. 
We now form D(o, u] — D[u, @] using (3.37), integrate over the region which 
consists of that part of B outside of a small circle C with radius 6 and centre 
(%), Yo) and then let 6 tend to zero. Since the contribution from fu(V?o), ds 
C 


becomes 82 4(%9, ¥g) and all other contributions from integrals around C tend to 
zero as 6->0, we have 


8Uu(%, Vo) = ffoViudxdy + flu,V2o —u(V70),4 e(V?u),— e,V?ujds. (3.41) 
B Jp 
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§ 4. Some error distribution principles 


We describe here some approximate methods which use various principles for 
distributing the error as uniformly as possible throughout the domain of the 
solution. These are generally applicable in all the following chapters, including 
Ch. VI, but for convenience they are described here with reference to partial 
differential equations. 


4.1. General approximation. ‘‘Boundary”’ and ‘‘interior’’ methods 


Problems in differential equations are often attacked by assuming 
as an approximation to the solution u(x,,..., %,) or y(x) of an initial- 
value or boundary-value problem (1.9), (1.10) an expression of the form 


UPSD (Se, 5.05 %py By, ove Ap) (4.4) 


which depends on a number of parameters a,, ..., a, and is such that, 
for arbitrary values of the a,, 


(1) the differential equation is already satisfied exactly (“boundary”’ 
method), 

or (2) the boundary conditions are already satisfied exactly (‘‘interior”’ 
method), 

or (3) w satisfies neither the differential equation nor the boundary 
conditions, in which case we speak of a “‘mixed’”’ method. 


One then tries to determine the parameters a, so that w’ satisfies 


in case (1) (boundary method) the boundary conditions, 

in case (2) (interior method) the differential equation, 

in case (3) (mixed method) the boundary conditions and the dif- 
ferential equations 


as accurately as possible in some sense yet to be defined (this is 
done in § 4.2). 

For ordinary differential equations interior methods are used mostly, 
for if we did know the general solution of the differential equation, the 
fitting of the parameters to the boundary conditions would still require 
the solution of a set of simultaneous (possibly non-linear) equations. 
For partial differential equations, on the other hand, both boundary 
and interior methods are used, but in general boundary methods are to 
be preferred since their use, in so far as integration is involved, requires 
the evaluation of integrals over the boundary rather than throughout 
the region. This applies also when collocation is used: the two types 
of method offer the alternatives of boundary collocation and collocation 
throughout the region, the former being the more acceptable and less 
prone to error (see Ia of the following section). Mixed methods (case 3) 
are used when the differential equations and boundary conditions are 
rather complicated. 
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If, in case (1), we insert the approximation w in a boundary condition 
V,,=0, we are left with an error function 


Br Mien tans aap) | 
Se ees Xp, «9s Way Wray. sy Waes sss) 


defined on J, (the subscripts to w denote precisely the same partial 


(4.2) 


derivatives of w as were defined for w in (4.11), eg. ay 
Similarly, for case (2), we have the error function oes 


&(%;,4,) = F(x;,W, ,..., Wy4,...) (4.3) 


defined in the region B and for case (3) we have two error functions «, 
and «. The parameters a, must then be determined so that these error 
functions e, and e approximate the zero function as nearly as possible 
on I, and in B, respectively. Various principles can be formulated for 
doing this, which we now describe; for brevity we will usually refer 
only to the error function ¢ for case (2), but what is said is naturally 
applicable also to «, for case (1) and to both « and «, for case (3). 


4,2. Collocation, least-squares, orthogonality method, 
partition method, relaxation 


Ia. Pure collocation. The error ¢ is made to vanish at # points 
f,,...,P,—the “collocation” points. One tries to distribute these p 
points fairly uniformly over the region B or boundary surfaces J). If the 


co-ordinates of the P, are x,,,..., %,., then the equations for determining 
the a, réad 
Opa, Megs Mags G15 --+ Xp) 0 (Oe 2) (4.4) 


In general, collocation should be used as a boundary method wherever 
possible, for a reasonable uniformity in the distribution of the collocation 
points can be achieved more easily on the boundaries [/, than in the 
region B. (It is, for example, easier to arrange p points uniformly around 
the circumference of a circle than throughout its interior.) Few inves- 
tigations have been made into the suitable choice of collocation points. 


Ib. Collocation with derivatives. The calculation is sometimes 
simplified if ¢ is not equated to zero at p points but at g (<4) points, 
the number of the equations for the a, then being made up to ~ by 
equating to zero derivatives of « at several points which may or may 
not coincide with any of the first g points. 


Ila. Least-squares method. Here we require that the mean square 
error shall be as small as possible: 


k 
Ja=fedtt+)> f &idS =minimum. (4.5) 
B 


pol Ih 
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For a boundary method (case 1) the first integral, over the region B, 
would not appear and for an interior method (case 2) the second term, 
involving integrals over the boundary surfaces, would be absent. The 
requirement that J should be a minimum leads to the well-known 
necessary conditions 


k 
Ch ay ee LET =4,.. 6 
2, da, =e Ga, +z f # Ga, : (e : ?), cs ) 
u 


which constitute equations, non-linear in general, for the determination 
of the a,. 


IIb. Least-squares with weighting functions’. Let P(x,,..., x,) 
and P,(x,,...,%,) be chosen as positive weighting functions in B and 
on I, respectively. Then instead of (4.5) we require that 

k 
J=JfPédt+y) fP,&dsS =minimum. (4.7) 
B a I, 


III. Orthogonality method. For an interior method (and similarly 
for a boundary method) we choose # linearly independent functions 


8, (%1, +++, %,) and require that ¢ shall be orthogonal to these functions 
in the region B, i.e. 
{ e&.¢7=0 (@=41,-70)8 (4.8) 


the g, are often chosen to be the first p functions of a complete system 
of functions in B. 


IV. Partition method. The region B (and similarly each bounding 
surface I), for a boundary method) is partitioned into p sub-regions 
B,,..., B, and we require that the integral of ¢ over each sub-region 
be zero, 1.e. 


Jedu—0 (eet (4.9) 
Bo 
V. Relaxation. We choose a set of values of the a, and calculate 
the corresponding values of « (or ¢,) at a large number of points in B 
(or on I); these values are called the “‘residuals’’ in relaxational parlance. 
We then note what changes are produced in these residuals by altering, 
or “relaxing’’, each a, in turn by an amount da, say. It is frequently 
quite easy to see from this how much we must alter the individual a, 
by in order to make the magnitudes of the residuals as small as possible. 
This method allows one considerable latitude in the actual calculation; 
with practice it often leads to the required result more quickly than 
any other method. 


1 PiconeE, M.: Analisi quantitativa ed esistenziale nei problemi di propagazione. 
Atti del 1° Congresso dell’Unione Mathematica Italiana 1937. 
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This list of principles can easily be extended but those already men- 
tioned are, in fact, the ones which have been most used hitherto. While 
on the subject of error distribution, we should also mention the principle 
of the smallest maximum error, which is of importance for boundary- 
value problems with elliptic differential equations (see Ch. V). 

Combinations and variations of these principles may also be used; 


for example, one can choose g (>?) points PB, wait ain band require 
that 


q 
J= 25 [e(B,, Ay, +++, ay) /<— minimum, 
o=1 


so that the a, are determined by the equations ee =(0 (0 owe ae 
e 


Many further variants can be devised; see, for example, Note 3 in 
Chath, $ Sages 


4.3. The special case of linear boundary conditions 


We now assume that the boundary conditions are linear and of the 
form (1.13), although the differential equation may still be non-linear. 
We may therefore take the approximate solution w to be a linear 
expression 


p 
Boe Ves Tl 2a igs +++ Xs) (4.10) 
Q 


in the parameters a, with v, satisfying the inhomogeneous boundary 
conditions and the v, the corresponding homogeneous conditions, i.e. 


U,, (Uo) = Yu aa (4.14) 
U,,(v,) = 0 o=1,...,p) (4.42) 


This ensures that the w given by (4.10) satisfies the prescribed boundary 
conditions (1.13). The v, are naturally assumed to be linearly in- 
dependent. 

All the principles described in § 4.2 can, of course, be applied to 
problems of this particular type, but we single out for mention here a 
noteworthy special case of the orthogonality method (principle III of 
§ 4.2). 


IIIa. GALERKIN’S method. This is the special case of the ortho- 
gonality method in which the functions v, are used for the g,; thus the 
equations (4.8), with ¢ replaced by its explicit formula (4.3), here read 


aes ae, Wi), ...,0,, -..) U(%,---)%_) aT = 0 
B 


(9 =14,...,P). 
These are GALERKIN’S equations and are easily remembered (cf. § 5.3, 
ire TTT). 


(4.13) 
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If the differential equation is linear as well as the boundary conditions, 
then the equations determining the a, are also linear for any of the 
principles listed in § 4.2. Further, the least-squares method can be 
regarded as the special case of the orthogonality method in which 
&, = e/0a,. 


As in (1.12), let the linear differential equation be written 
L{u| =r, (4.14) 


where L[w] is a linear expression in uw and its partial derivatives and 
r(x,,..-,%,) is a position function in B. The error function ¢ is now 
linear in the a,: 


p p 
e=L[w]—r= 2 aL [%] + L [v9] =f alee YW—r, (4.15) 
o= o= 


where we have put) cee ee) — 


I. If collocation is used, # collocation points P, with co-ordinates 


%19,+++,%,» are chosen and the a, found from the # equations 
p 
ye,,4, = dies (4.16) 
v=1 
Wiitere 900 Vin tonne oe ea, 
and Ut (Liar ess Sng) See ies <5 taxa) (4.17) 
III. Similarly, if the orthogonality method is used, # functions 
& (%1,---» %,) are chosen and the a, determined from the p equations 
b 
Di py 4, = ic, (4.18) 
v=1 
where Wo5=) £V.dt (6 =e 
B 
and t, sail go(r—V)dr (4.19) 


As mentioned above, these include as special cases GALERKIN’S! equa- 
tions when g,=v, (principle IIIa) and the equations for the least- 
squares method when g,—L[v,]=V, (principle IT). 


1 GALERKIN, B. G.: Reihenentwicklungen fiir einige Falle des Gleichgewichts 
von Platten und Balken. Wjestnik Ingenerow Petrograd 1915, H. 10 [Russian]. — 
Hencky, H.: Eine wichtige Vereinfachung der Methode von Ritz zur angendherten 
Behandlung von Variationsaufgaben. Z. Angew. Math. Mech. 7, 80—81 (1927). — 
Duncan, W. J.: The principles of the Galerkin method. Rep. and Mem. No. 1848 
(3694), Aero. Res. Comm. 1938, 24 pp. 
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IV. If the region B is divided into sub-regions B,, then for the 
determination of the a, by the partition method we have ihe p equations 


p 
x 2oy 4, = (ap , (4.20) 
where a — ear, (or 4 
’ Bo 
and a = (r, —Vi) dr (4.21) 
e@ 


4.4. Combination of iteration and error distribution 


Consider the problem (1.9), (1.10) with the differential equation in 
the form 
M(u] = P[u], 


where M and P are functions of the x,;, « and its derivatives. We define 
an iterative scheme in which a sequence of approximations u, is generated 
from an arbitrary function “, by the equations 


M [ty +1] = Plu], ETERS! 
U, [411] = Vp (u=4,...,h) 


u, can still be chosen to depend on parameters a, ...,a,, in which 
case 4, will also be a function of these a,; we can then demand that uy 
and 4, shall be as close as possible, i.e. that the difference 


C=C (a,,%;) = uy — Ue 


shall be as small as possible. The error distribution principles! de- 
scribed in § 4.2 are at our disposal for satisfying this requirement. 

If P[u] is linear in w and contains no derivatives of u, i.e. the 
differential equation has the form 


M [u] = p(x;) + 9(%;) 


q(x) = p(x) + 9(%;) 1 — M [m4] 


and, apart from the factor ¢(x,) multiplying ¢, the method coincides 
with the ordinary error distribution methods of § 4.2 only now they 
are applied to the first iterate 4, obtained from uy. With a suitable 
choice of M and P we may expect better results from this method than 


then 


1 NovoZiLov, V. V.: On an approximate method of solution of boundary 
problems for ordinary differential equations. Akad. Nauk SSSR. Prikl. Mat. Meh. 
16, 305—318 (1952) [Russian]. [Reviewed in Math. Rev. 13, 993 (1952); also in 
Zbl. Math. 46, 343.] NovoziLov gives particular prominence to least-squares and 
collocation. 

Collatz, Numerical treatment, 3rd edit., 2nd print. 3 
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if we had applied the error distribution methods directly to the error 
function formed with u,. An example using a combination of iteration 
and collocation will be found in Ch. III, § 4.8, I. 


§5. Some useful results from functional analysis 


In this section we first prove a fundamental general theorem on iteration which 
can be used effectively in several places in this book. In order to avoid placing 
needless restrictions on its range of application from the <tart, it is necessary to 
employ a general formulation. The representation of functional analysis can be 
used with advantage for this purpose, for, although it seems rather abstract at 
first, it proves to be very fruitful. Certain manifolds of functions (or other “‘ele- 
ments’’) are considered and each “‘element’’ is regarded as a ‘‘point”’ of a ‘‘space’’. 
The introduction in § 5.1 is purposely kept broad. 


5.1. Some basic concepts of functional analysis with examples 


Let S be an abstract space containing elements denoted by f/f, f,. /2. 
In this book these elements will be continuous functions but this — 
is not used in the general = of § 5.2. The symbol < used in f< 
signifies that f “is contained in” S. For any two elements /,, f, of de 
space (or, shortly, for f,, /,€ S) we define a ‘‘distance’’ as a real number 
\|fi—f2|| with the following properties: 


4. Symmetry: ||/,—fel] = [fa — All- 


2. Positive definiteness: ||/,—/,|| 20 for any f,,f/,¢S salad 
\|i—Aal| =0 if and only if f,=fy. (ee 

3. SS inequality: ||4A—/sl[S||A—/|| +|l4— fal = 6.2) 
hfe hes .. 


For the space S® of single-valued continuous functions /(x) of the real 
variable x in the closed interval <a, b) we might define the “distance” 
between /, and /, as the maximum absolute value of the difference f, —/y: 


IA — fall = max JA (2) — Alo; (5.3) 


it can be seen immediately that this definition possesses the three 
properties listed above. For the same space we could define a more 
general distance by 


lA — fall = max Ae Ae (5.4) 


asxsb W (*) 
where W(x) is a fixed, positive, continuous function in (a,b), e.g. e°. 


For the applications in this book there. is usually a commutative 
addition of elements, and with respect to this addition S forms an additive 
group. S contains a zero element @ such that, for /,« S, O+/,=/, and 
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to each f, there corresponds an “inverse element” — /, with f+ (— /,) = 

(In the above example S = S°, the function f(x) =0 is the zero element.) 
For such function spaces one can work with the “norm” ||f|| of an 
element f instead of the ‘‘distance’’; the norm is the distance from the 


zero element: 
HA lt — Olf- (5.5) 


Further, we need the idea of the completeness of a space S or sub- 
space F of S. A sub-space F of S (which may be improper, i.e. coincident 
with S) is termed complete when to every sequence /,, /,, ... of elements 
in F such that 


tt Mtn — fall = (5.6) 
there is a limit element / such that 
Jim lf ~ fll =0 6.7) 


which also belongs to F. 

It is an important fact that the space S° of continuous functions in 
“a,b>, considered as an example above, is complete under the distance 
definition (5.4), as also is the sub-space of these functions for which 
u,(x)Sf(x)<Su,(x), where u,(x) and u,(x) are two fixed, continuous 
functions in “a, 6, with u4,Su,. This can be seen from (5.4) and (5.6), 
which imply that 

[fm — fal Sell fn — fall, 
where 6 = max W(x), and hence the sequence /, (x) is uniformly con- 
vergent; as is = well known, the limit function of a uniformly convergent 
sequence of continuous functions in a closed interval is also continuous 
and hence belongs to the space considered, which is therefore complete. 

We now define an “operator” (or ‘“‘transformation’’) T which asso- 
ciates a unique element T/ of a sub-space F* of S with each element / 
of a sub-space F (the inverse mapping of F* onto F need not be unique, 
nor need F* be different from F). 

In the space S® we can construct a considerable variety of operators, 
for example, 


Tp=Si@ak, TH=HxjW(o, Th=sin({(x)): 


on the other hand, Tf =d//dx need not be an admissible operator, for, 
if the sub-space F is chosen appropriately, differentiation can lead to 
functions not belonging to S®. 

L ee St.: Théorie des opérations linéaires. Warsaw 1932. Recent im- 


pression New York 1949, p. 11. 
Sad 
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An operator T is said to be Lipschitz-bounded in F with reference 
to the chosen distance definition if there is a ‘Lipschitz constant’”’ K 
such that 
ITA—TAllS KllA— All (5.8) 
for all /,, f.€F. 
To give an example, let us consider again the space S° of continuous 
functions in <a,b> with the distance definition (5.4) and define an 
operator T by 


T(x) =f G(x, 8) #6) dé 


where G (x, &) is a given, continuous, bounded function with | G(x, &)| SC 
for a<x, &<b. This operator is Lipschitz-bounded under the distance 
definition (5.4) since 
SOE TE) — fg l(ENeS 
oa = z | 
IITA — Thall paeae W(x) 


fie(xg)| Wie ag 
= 2 s 
ete Al max W(x) 


asxsb 


If we put y= max 


, then yC can be used as the Lipschitz 
constant K, “=**? We) 


5.2. The general theorem on iterative processes 
Suppose that we require the solutions of the equation 
oes (5.9) 


(or the “fixed points” or fixed-point elements of the operator T). Let 
us set up the iterative process! 


bo Tash (4 = 0, 1, 2% ss) (5.40) 


whereby we proceed from a function u)¢ F and form #4, = Tuy, uy = Tu, 
and so on up to w,,, as long as u, lies in F. Then, if F is complete and 
T Lipschitz-bounded in F, we have for 0<n<m 


|| mn — mM, || 7 | Py —1— Tu,_4|| = K || 1 — ",—1|| s-. 


i (5.41) 
SK" || 44-9 — Un—el| (for OS rsm,n), 

1 KANTOROVICH, L.: The method of successive approximations for functional 
equations. Acta Math. 71, 63—97 (1939). — WetssinGER, J.: Zur Theorie und 
Anwendung des Iterationsverfahrens. Math. Nachr. 8, 193—212 (1952). 
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and from (5.2), (5.11), it follows that 


m—1 
|| me — %n|] SO [I #541 — %.l| 
s=n 


m—n m—n 


= 2 K'|| 4, — @,~4|| S K*-? 2 K'|| a, — uto||. 


We now make the crucial assumption that K<1, so that 


m—n 


K 
ee and ||u,,— ell Sent 


“zl —moll- (5-12) 


We observe now that an important sub-space of S is the ‘“‘sphere” 
containing all the elements # in S with 


K 
|| — 4 || Sz || — Il, (5.43) 


for it has the property that, if it is contained in the sub-space F, then 
the iteration process can be carried on indefinitely, i.e. no u, falls outside 
of F; this follows from (5.12) with n»=1: 


| — |] Se Il — ma] (5.14) 


for this implies that u,, lies in the sphere 2’ (and hence also in F) for 
m=1,2,3,.... It follows further from (5.12) that 

lim ||«,,—,|| = 0 
since K<1, and hence, on account of the completeness of F, there 
exists a limit element u in F such that 

Jim || 4 — | =0. (5.15) 


Since # lies in F, we can form 7; then from (5.2), (5.8) we have 
|| Tu — ul] S|] Tu — Tell + |] Pe, — al] S Kl] — oll + [leer — a 


for all n. Now according to (5.15) the right-hand side tends to zero as 
n—> oo; hence io, 
so that, from the “‘distance’’ property (5.1), Tu=vw. 

Thus the limit element u is a solution of (5.9), and the existence of 
a solution is demonstrated. 

Suppose now that there exists another solution v of (5.9), so that 
v= Tv. Then from (5.8) we have 


||l4 —»|| = 174 — Tol] SK||4—ol], 


and since K<.1, we must have |] —-r|) <0. ie. wee. Thus (5.0) ean 
have only one solution in F, and the uniqueness of # in F is alse 
demonstrated. 

Finally, it follows from (5.2), (5.14) that 


\|w — my] Sow af = Ga = ll Shoal, = Sy I Mell. 
and sinee, according te (8.18), the term || @ ~ || +0 as m—> x, we have 

#41 Sell — ll. (5.16) 
i.e. w itself lies in the sphere S. This formula prevaies am error estimate. 


Summary: Leé seers be an cowatien foe Te (5.0) fer am edemoms ¢ 
of a space S. Tf we cam detine a dissimer savis*vimg she Merce somdiecoms 


of §5.4 and can choose a sub-space F so thai 
1. Tf ts defined uniquely for all f in F, 
2. F ts compliers sendicr the chosen aisiauce dotiemen, 
3. T satisfies a Lipschits-condition in F with K< 14, 
J. Resides thee chesem t,. F commains che whele sphare S d&otvmed bs (3.15). 


then the «ieration G.10) omy br tontiewd auibteiiy eaf dee 
sequen te, converges tm the somse af (6.15) & an sioment a oe DL anbook 
1S te wnegted solution OF the givem equation (5.0) ge Mee swe-space FL Ac 
The Sane Seem S10) coves dee cstimente for the orn ca the apo imeatreg 6, ). 


In many cases it is obvreus that all w, le in & awd the comdrsien 4 
can be onutted. Closer error estimates can be obtaimed wm several Cases 
by usurg pseude-metrrc spaves?; the distanee [/f- ¢') between twe 


elements 7. ¢ of such & space ts an clement ef a senm-orderetl space and 
thus is net restricted to being a real number, ef. Ch. 111. 848. 


5.3. The operator T applied to boundary-value problems 


Consider the beundary-value preblem with the differential equation 


Liu) =¢(%y,....% 0) in B (5.47) 
\ Awether general methed based of functonal anetver hes been aovectigeted 
by P.'G. Respxeveem: The methed of sseepest Geseant Pree Svea Ape Meck 
VI, New York-Toronto-Londen 1936, pp. 127— 176. 
= Kuregpa, L.: Tableaux ramifiés d’ensembles, espaces pseude-distanciés. C. R. 
198, §563— 1565 (1934). — Scurdper, J.: Nichtlineare Majeranten beim Verfahren 
der schrittweisen Naherung. Arch. Math. 7, 471-484 (1080). — Neue Fehler- 
abschaeeurngen fr verelwedene lreratterswedahier Fo Meeew Week Week 6 
16S—1S8t (1086). — Uber das Newtonsehe Verfahren. Arch. Rational Mechanics 1, 
154—180 (1957). — Das Iterationsverfahren bei allgemeinerem Abstandsbegtiff, 
Math. Z. 66, 111—116 (1050). 
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and the linear boundary conditions as in § 1.3 
U,[uj=y, onl (u=41,...,h), (5.18) 


where L(u) and U,‘u] are linear homogeneous differential expressions 
in a function u(x,,..., x,) and @ is a given function with a continuous 
derivative with respect to u and which we will assume to be continuous 
with respect to its other arguments. We can proceed from an arbitrarily 
chosen function uy according to the iterative formulae 


L(tys1] = 9(%).%,) in B 


(q=0,1,2,...). (5.19) 
U,, [4,41] a Vu on d 


Thus “,., is determined from u, by solution of a linear boundary-value 


problem. 
Now let us assume that for any continuous functions 7, y, the problem 


Pei=r in B, U,[y]=y, on I), (5.20) 


when a GREEN'S function G(x,, £,) exists (see § 3.4). Then the iteration 
cycle can be repeated indefinitely provided that ¢(x,, u,) is defined for 
allu=u,. 

With the aid of a function u satisfying the inhomogeneous boundary 
conditions, and also possessing continuous derivatives of as high an 
order as is necessary for the formation of L’a_, we can transform the 
problern into one with hornegencous boundary conditions (this trans- 
formation is used only in establishing an error estimate and is not needed 
in carrying out the computation). Corresponding to a function f we 


can define a function g by 
L{gl=o(%,u+f—L{u] in B, U,[g]=0 onl); (5.21) 


we write this correspondence as g~ 7/7, thus defining an operator T. 
If now we put u=wu + and u,—u-+-v,, then 


ta Ty, G@=0,1,...) and v=Tv, (5.22) 
and since 


U4 


—u“=U,—9, (5.23) 
the error at the g-th stage is unaltered by the transformation from u to v. 
Jo determine the Lipschitz constant A of the transformation 7, 


we form ” Z 
Ligy - Bj = p(x;,4 ah Pp (%;,% + fe), a (5.24) 


Ui Ab, - Lop =O, 
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where g,=T7/, and g,=Tf},. We then choose a domain D of the 
(x1, ..., %,,%) space which is convex with respect to u and contains a 
solution « and the iterates u, to it and assume that @ satisfies the 
Lipschitz condition 


| (x42) — 9 (aj, 24) S N(x) [2 — 241 (5.25) 
in D. Since possesses a continuous derivative with respect to 4, we 
could put N = max oo at From (5.24) and (5.25) we have 

[L[A)|S Nh] in B, U[A]=0 on ff, (5.26) 


where h=},—/, and H=T/,—Tf},. From here we can proceed in 
two ways. 


4. Using the GREEN’s function. Let W(x,) be a positive (or possibly 
non-negative) function in B and, as in (5.4), let the norm of / be defined 


by 
V/ll = upper tim | L, 6.27 
in B 
Now the inequality in (5.26) can be replaced by the equation 
L[H|]=@ON|h|, where |8/ <1, 


which can be solved for H by means of the GREEN’s function, as in (3.24): 


H= Joe x;,&) N(E,) | A(E,)| €&;; 
hence 
Fens E)N(E) h(E) | 46; |All DINE) WE)aE;, (5-28) 
and we can use 
L1G »§)| N(E) WS) a; 
K = upper lim 2 —___. (5.29) 


in B W(x) 
as Lipschitz constant. 
If the boundary-value problem is linear, so that the differential 


equation (5.17) can be put in the form 
L[u] = p(x;)« + 9(x)), (5.30) 
then (5.25) holds with N(x,) =| p(x;,)|. 


A simple, if deinen crude, error estimate can be given when a 
non-negative GREEN'S function exists in B and the eigenvalue problem 


L{[z]}=az in B, U,[z]=0 on LI) (5.31) 


rod 
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possesses a non-negative eigenfunction z(x;) in B corresponding to the 
eigenvalue A=A,. We can then choose W(x,) =2(x,), so that, since 


A, J @(x;,§)) 2(8) d&; = z(x;) (5.32) 
from (3.24), (5.29) simplifies to 


N(x. 
ge? 


(5.33) 


2. Using a monotonic property. Here we make use of the concept 
of a boundary-value problem of monotonic type, thus limiting ourselves 
to real values (see §§ 5.4, 5.6). For our present purposes we modify 
the definition slightly and say that the problem (5.17), (5.18) has a mono- 
tonic character when 


L{vy]SL[w] in B,  U,[v] =U,[w]=0 on I, (5.34) 


¢4 


implies that v Sw, v and w being two functions with continuous partial 
derivatives of as high an order as is required to form L and U,. 


Now let z(x;) be a function such that 
L{z]=A(x)2a>0 in B, U,[2]=0 onl), (5.35) 
where « is constant. Then under our assumptions it follows from 
[L[y]|=D=const in B, U,[y]=0 on I, (5.36) 
that |p| is majorized by zD/«: 
lyjs 7; (5.37) 


for we have 


L(/=*] S—DsLly|sDst|*?|, 
a a 
7 (5.38) 
u,|+ - |=4.00) = 0; 
and hence, from the monotonic property, 
ss (5.39) 
ax a 
We now apply (5.36), (5.37) to (5.26); this gives 
|H|< ible : (5.40) 


Using the same norm as defined in (5.27) with a similar function W(x,), 
we obtain 


N max 5 Ae 
a (| 5 ea: (5.41) 
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we can therefore use 
N ax 
Ka NZ imax, (5.42) 


a 
as Lipschitz constant. 
Detailed numerical examples will be found in Ch. III, § 4.8. The 
methods of § 5.2 are also applied to a non-linear integral equation in 
Example III of Ch. VI, § 1.5. 


5.4. Problems of monotonic type! 


Let R be a real space of elements u,v, ...,/,g,.... These elements 
may be real numbers, vectors with real components or real-valued 
functions of real variables and the signs <, <, >, = shall have their 
usual significance; applied to vectors, for example, the sign S signifies 
that the inequality holds for all components. (In the terminology of the 
theory of abstract spaces, R is a semi-ordered space.) 

Let there be given an operator T which associates with each element 
of a proper or improper sub-space M of R a unique element of an image 
space M* which is also a sub-space of R. The operator JT need not be 
linear. Now let / be a given element of R; then we ask for the solution u 
(an element of M) of the equation Tu=/. We say this problem is 
“of monotonic type’ (or T is a monotonic operator) when TvS Tw 
implies that v<w for arbitrary elements v, w in 1%. More accurately, 
we should say that the problem is “‘written as a problem of monotonic 
type’’, for it can certainly happen that a particular problem of analysis 
can be formulated in different ways such that one formulation is of 
monotonic type while another is not. 

If we assume the existence of a solution uw, there is the possibility 
of “bracketing” it when the problem is of monotonic type: if v7, and v, 
are two approximate solutions in M such that 


Ty,Sf/STr, (5.43) 
then 
SUS dg. (5.44) 


There is also the possibility of deducing an error estimate for results 
obtained by the relaxation method. With the relaxation technique we 
define the ‘‘defect”’ or, in the customary terminology of relaxation, the 
“residual”, d—d(v) = Tv—f of an approximation v and try to make 
it approximate the zero element as closely as possible by making 
alterations in v, usually in the nature of small corrections. If we find 
that d20, we know that vw and similarly vs follows from d<o. 


} CoLtiatz, L.: Aufgaben monotoner Art. Arch. Math. 4, 366—376 (1952). 
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The monotonic method requires that we know that a solution x 
exists; this knowledge can be acquired in several ways: 


1. It is often possible to make sure that a solution exists by starting 
the iteration procedure of § 5.2, possibly with quite a crude first iterate, 
and appealing to the general theorem of § 5.2 (cf. Ch. III, § 4.8, Ex. JOR 


2. With the aid of topology and functional analysis, generalizations 
of Brouwer’s fixed-point theorem can be used to establish results 
concerning the existence of a fixed point for a wide range of problems; 
for example, non-linear boundary-value problems for elliptic differential 
equations have been considered by SCHAUDER and LERAyY! and non- 
linear integral equations by RoTHE?, among others. 


3. For certain classes of linear and non-linear boundary-value prob- 
lems the existence of a solution is assured by special theorems. 


5.5. Application to systems of linear equations of monotonic type 


Consider a system of real linear equations, which may be written 


in matrix form 
Ax=r, (5.45) 


where A = (a;,) is the matrix of coefficients, x =(x,) the column matrix 
(or vector) of the unknowns and 7 = (r,) the column matrix of the right- 
hand sides. A corresponds to the operator 7. The problem of deter- 
mining x is of monotonic type when Az=O implies that z=20 for any 
real vector z. Such a matrix A is called “monotonic” or “of monotonic 
type’, as also is the system of equations Ax =r. By reversing the sign 
of z we see also that Az<0 implies z<0 if A is monotonic; therefore 
Az=O implies that z=0, and the determinant of A cannot be zero. 
For a monotonic matrix A, AySrSAw implies that ySx<vw, for this 
is equivalent to: A(y— x) SOS A(w— x) implies that y—xSO0Sw—x; 
in particular, we can conclude from | Ax|< Ay that |«|<y (correspond- 
ing to the definition in § 5.4, |x| <y signifies that |x,| << y, forj =1,..., m). 

A necessary and sufficient condition for a matrix A to be monotonic 
is that all elements of the inverse matrix A™! be non-negative; for 
practical work, however, we need simpler criteria which do not involve 


1 ScHAUDER, J.: Zur Theorie stetiger Abbildungen in Funktionalraumen. Math. 
Z. 26, 47—65 (1927) and notes thereto 417—431. — Lrray, J., and J. SCHAUDER: 
Topologie et €quations fonctionelles. Ann. Sci. Ecole norm. sup. 51, 45—78 (1934). 

2 RortueE, E.: Zur Theorie der topologischen Ordnung und der Vektorfelder in 
Banachschen Raumen. Comp. Math. 5, 117—197 (1938). 

3 Another criterion which includes our Theorem 1 is given by A. OSTROWSKI: 
Uber die Determinanten mit iiberwiegender Hauptdiagonale. Comm. Math. Helv. 


10, 69—96 (1937). 
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determinants and can be applied easily, even if they are only sufficient 
conditions. Such a criterion}? is furnished by: 


Theorem 1. If an » xm real matrix A is such that 

1. a;,30 for 7h, 

2. A does not ‘decompose’, 

3. there exist non-zero vectors y and r such that y>0,r2O0 and Ay=r, 
then A is a monotonic matrix. 


We say that a matrix A = (a;,) “decomposes” when for some integer 
min 1<m<n—1 we can separate the integers 1, ..., 7 into two groups 
Or» +++) Om> Fr, +++) Fy—m in such a way that a,4,—0 for v=—1,...,m; 
i iy I i 11.8 


Proof. For x=0 to follow from Ax=O0 we need only show that the 
two assumptions 
(a) z is a vector with at least one negative component, say z,<0, 
(b) Az=0 
are contradictory. 


From assumption (b) it follows that A[(t—A)y+Az120 if the real 
parameter A lies in the interval O<A<1, y being the vector of condi- 
tion 3. Now under assumption (a) we can choose A=.1 in 0<A4<1 so 
that the vector w= (1— A) y+ Az has no negative components, but has 
at least one zero component and is not the zero vector. For since y,>0 
and z,<0, there is a A=4, in (0, 1> such that (1—A,)v,+ A,z,— 0, and 
similarly for any other negative component of z, say s,, there is a 4, 
in <0,1> such that (1—A,)v,+A,z,=0; we then let .{ be the smallest 
of these values A, (there are at most » of them); w is not the zero vector 


since with 0<A<1, Ay=O and — y= —z imply that AzS<O0 and 


with assumption (b) this implies that 4z=Ay=0, in contradiction to 
condition 3 that r is a non-zero vector. 

We now use conditions 1 and 2 to contradict the deduction from (b) 
that Ara 0. Letew), ..., am, “attd m,.,...9 w,,_, be the zero and non- 
zero (and therefore positive) components of w, respectively. Now 


1 A similar criterion is demonstrated geometrically by G. ScHuLz: Interpola- 
tionsverfahren zur numerischen Quadratur gewdhnlicher Differentialgleichungen. 
Z. Angew. Math. Mech. 12, 53 (1932). The conditions which ScHULz obtains are: 
detA + 0, a;;>0, aj;<0 for 7+ k, and our condition 3. with y>0, 

® That the criterion is not necessary, even in the sense that at least one re- 
arrangement (by row or column interchanges) of a monotonic matrix must satisfy 
it, is easily shown by simple examples such as the monotonic matrix 


_ Sy gp SS 
(-2 : el. 
2. == 
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1SmSn—1, so that, since A does not decompose (condition 2), there 
is at least one element a,,,, which is non-zero and therefore negative 
(condition 1). Then calculating the o,-th component of Aw, we obtain 


n n—m 


(A w),, = 2 Gombe = 2 M090 Wo, <9, (5.46) 
= B= 


so that at least one component of Aw is negative. 


If the vector y of condition 3 satisfies the stronger condition in which 
r>0, condition 2 may be relaxed. For in this case A((1—A) y+Az)>0 
if OS/<1, so that Aw>0; 9, is therefore chosen arbitrarily this time 
and we cannot say that there is at least one negative a,,.o,; however, 
since Qo, o,=9, (5.46) holds with < instead of < and we still have a 
contradiction, this time with Aw>0. 

As the special case y;=1, Theorem 1 includes a criterion which is 
used very frequently in applications: condition 3 becomes the weak 
“row-sum”’ criterion! 

be 
7 | =0 for all j 

a 


k= >0O for at least one 7 =; 


consequently conditions 1, 2,3* are sufficient for A to be monotonic. 
The case where 7>0 in condition 3 corresponds to the ordinary row-sum 
criterion as defined below. We may therefore state the less general 


Theorem 2. If the coefficients a,, of an nxn matrix A satisfy the 
conditions 

1. sign distribution?: a;;>0, a;,S0 for 7+R, 

2a. the “weak row-sum criterion’’ ; 


es ea) forage 12)... H; 
Zu >0 for at least one 1 =14po, (5.47) 
and 2b. the non-decomposition of A, 
or, instead of 2a. and 2b., the stronger condition 
2c. the ‘ordinary row-sum criterion” : 
2 4;,>0 for7=4,...,%, (5.48) 
k=1 


then A 1s monotonic and in particular det A +0. 


1 Cotratz, L.: Aufgaben monotoner Art. Arch. Math. 3, 373 (1952). 
2 It is convenient to include a,;>0 as a condition of the theorem although 
it can be deduced from the remaining conditions and could therefore have been 


omitted. 
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The solution x of the system of real equations Ax=yr can then be 
bracketed by 1,5 xSv_q provided that two approximations v, and vz. can 
be found such that Av,;SrSAvg. 

Systems of equations of monotonic type occur frequently in the 
solution of boundary-value problems by finite differences. As these 
systems of equations are often solved by iteration we conclude this 
section with mention of a theorem which will be used later in this 
context. 

A series of iteration procedures can be defined by writing the given 
matrix A as the sum of two matrices B and C: 

A=B+C; 
then starting from an arbitrarily chosen vector x) we determine a 
sequence of vectors x, from the iterative formula 
B*e4,+Cx%,=F7 (R=0)1,.2)e (5.49) 

We assume that det A +0 and det B+0. If B=(6,,) is chosen as the 
diagonal matrix with 

aes a;, forj7=k Pe 0 forj =k 

: 0 forj7=en, a;, for 7+k, 
the components of the current iterate are calculated directly from the 
preceding iterate; this iterative scheme is usually called the “‘total-step 
process”. If B is chosen to be triangular with 


yh for 72k _ | 0 fomger 
_ 0 forj<k, ™ a;, forj<k, 


(5.50) 


(5.54) 


then the components of the current iterate are calculated successively ; 
this is usually called the ‘‘single-step process’. 

The following theorem! gives sufficient conditions for the applicability 
of these processes. 

Theorem 3. If the matrix A of the system of equations (5.45) satisfies 
the ordinary row-sum criterion 


n 
D144] <4); C) Se eee) 
k=1 
hej 
or if it does not decompose and satisfies the weak row-sum criterion 


Bal 
k=1 
ke) 
then det A +0 and both the total-step and single-step iterative processes will 
converge when applied to the equations (5.45). 


Sa;; for — Ua rca 
<a,; for at least one} =4p, 


1Cf., for example, Math. Z. 53, 149—161 (1950). 
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Several matrices occur in later chapters for which we show that the 
conditions of Theorem 2 are satisfied. We therefore observe here that 
those conditions are included in the conditions of Theorem 3 as the special 
case for which the sign distribution of condition 1. of Theorem 2 holds 
and that the above-mentioned iterative processes therefore converge for 
these matrices. 


5.6. Non-linear boundary-value problems 


As in (5.17), (5.18), consider the linear or non-linear differential 
pation L[u] + F(x,,u) =0 in B (5.52) 


for a function (x,,..., x,) of m real variables x,,..., x, subject to the 
linear boundary conditions 


U, [4] =y, on L = eene Ie (5.53) 


Here F(x,,..., x,, #) is a given function in B possessing a continuous 
partial derivative with respect to u. Let us define an operator T (not 
the same operator as in § 5.3) by 


Tv =L|v)] + F(x;, 0) (5.54) 


with a domain of definition D restricted to the domain of functions v 
which satisfy the boundary conditions U,[v]=y, and possess partial 
derivatives of order sufficiently high for the formation of the differential 
expressions U,,[v] and L[v]. 

Then, for any two functions v and w in D, we have 


Tv—Tw=L{e]+eA(x,), (5.55) 
where €=v—w and A(x,) is obtained from TayLor’s theorem 
| OLS = 
F(x;,0) —F(x,w) =e(F7), |g =eAl), (5.56) 


@(x,) being a point intermediate between v and w; for fixed v and w, 
A(x,;) is a function only of position. Now let H be a domain of the 
(x,,...,%,, 4) space which is convex with respect to » and contains 
v and w (and hence also #); the assumption that A is non negative in H 
can be fruitful in several applications. One will frequently choose for H 
a domain which is known to contain a solution « of (5.52), (5.53) and 
also an approximation to it, say v; then, with w=u, ¢ is the error 
¢=v—u in the approximation v. If, on the basis of further special 


properties of the problem (5.52), (5.53), we can show that in H 
L{e] + eA(x,) 20 in B, . (5.57) 
U,{e]=0 on I, (5.58) 
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with non-negative A(x,), implies that e20, then the problem (5.52), 
(5.53) is of monotonic type in H. The non-linear problem is accordingly 
reduced to the discussion of a linear problem with homogeneous boundary 
conditions, cf. Ch. III § 4.9 and Ch. V § 4.1. 


Chapter II 


Initial-value problems 
in ordinary differential equations 


§1. Introduction 


First of all, in §§ 1.1—1.3, we discuss some quite general points mainly con- 
cerning accuracy. In §§ 1.4—1.7 some crude methods are described which would 
be used only if a rough idea of the solution over a fairly short range were wanted 
quickly. 


1.1. The necessity for numerical methods 


Even with quite simple differential equations it can happen that 
their solutions are not expressible in closed form and that a numerical 
approach is the most convenient way of dealing with the problem. For 
example, the differential equation 


dy 
cr 


sy 


does not possess a closed solution in terms of elementary functions, 
although its solution can be expressed in a complicated way in terms 
of little-tabulated Bessel functions of fractional order. Of course, when 
the coefficients appearing in the differential equation are empirical 
functions (such as the air resistance in external ballistics problems), 
some kind of approximate method, whether graphical, numerical or 
involving the use of an analogue machine, is the only way of obtaining 
a solution at all. 


General literature for this chapter 
(in chronological order) 


RunecgE, C., and H. K6nic: Numerisches Rechnen. Berlin 1924. 

Linpow, M.: Numerische Infinitesimalrechnung. Berlin and Bonn 1928. 

SCARBOROUGH, JAMES B.: Numerical mathematical analysis. 416 pp., in particular 
Ch.s XI— XIII. Baltimore and London 1930. 

Levy, H., and E. A. Baccot: Numerical studies in differential equations, Vol. 1. 
London 1934. 

KamKeE, E.: Differentialgleichungen, Lésungsmethode und Lésungen, Vol. 14, 
Ch.A § 8: Numerische, graphische und instrumentelle Integrationsverfahren, 
3rd ed. 666 pp. Leipzig 1944. 
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SANDEN, H. v.: Praxis der Differentialgleichungen, 3rd ed. Berlin 1945. 

ScHULZ, GUNTHER: Formelsammlung zur praktischen Mathematik. Sammlung 
Géschen, Vol. 1110. Berlin and Leipzig 1945: 

WILLERS, Fr. A.: Methoden der praktischen Analysis, 2nd ed. 410 pp. Berlin 1950. 

HaRTREE, D. R.: Numerical analysis. 287 pp. Oxford 1952. 

Mrneur, H.: Techniques de Calcul numérique. 605 pp. Paris et Liége 1952. 

MILNE, W. E.: Numerical solution of differential equations. 275 pp. New York- 
London 1953. 

Korat, ZDENEK: Numerical analysis. 556 pp. London 1955. 


1.2. Accuracy in the numerical solution of initial-value problems 


In an initial-value problem we have to determine approximately in 
some interval x,< 7<é that solution y(x) of an n-th order differential 


equation +4 = 
yg" = f(x, 9,9", «2, ¥") (1.1) 
which has prescribed “‘initial’’ values 
yx) = (vy =0,1,2,...,% —4) (1.2) 


at the “initial” point x =x). The existence and uniqueness of such a 
solution y(x) in this interval will be assumed. Most approximate meth- 


ods in current use yield approximations y,,..., y,,.-. to the values 
y(x,),..., ¥(x,),... of the exact solution at a number of discrete points 
EY a] 


The choice of method from among the numerous approximate 
methods available and the whole arrangement of the calculation is 
governed decisively by the number of steps, i.e. the number of points ~,- 
and the accuracy desired. In initial-value problems conditions parti- 
cularly unfavourable to accuracy are met with; not only is a lengthy 
calculation involved, in which inaccuracies at the beginning of the 
calculation influence all subsequent results (such is also the case, for 
example, when a large set of linear equations is solved by elimination), 
but inaccuracies in the individual y,, y,,... cause additional increases 
in the error; it can happen that solutions of the differential equation 
which lie close together at x = x, diverge considerably from one another 
at a subsequent point x= x,. This last remark, sounding as it does 
rather trite, is nevertheless of such consequence as to be worthy of 
amplification by an example. Consider the initial-value problem 


y"’=10y’ + 11y 

y=1, y'=-1 for *=0, 
whose solution y(x) is to be calculated approximately in the interval 
O<x<3. The exact solution is y(x) =e~*; this has the value y(3) = 
0-0498 at x =3, but the usual approximate methods will give completely 


false values for it. The general solution of the given differential equation 
Collatz, Numerical treatment, 3rd edit., 2nd print. 4 


(1.3) 
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is y=c,e~*+c,e"*, where c,,c, are constants of integration. Now if 
we calculate successively the values y,, y,,... at the points x, %5,... 
by any approximate method, the unavoidable rounding errors alone are 
bound to generate a component c,e'!*; even if we had an ideal method 
with no inherent error, this component, whose value at some point « =¢€ 
is e, say, would grow to ¢ Xe”? 3-6 x 10% by the time the point x =f +2 
was reached, so that, if we had been computing to seven decimals, for 
example, the exact solution e~* would already be completely swamped 
by it. Fortunately the conditions are usually not so unfavourable as 
in this “viscious” example, but it should always be borne in mind that 
carrying out an approximate step-by-step integration of an initial-value 
problem without some idea of the behaviour of the solution is like 
skating on ice of unknown thickness. 

Accordingly we distinguish two cases: 

Case 1. The solution is wanted only for a short interval and with 
moderate accuracy. Here we can use any of the crude methods of § 1.5; 
also analogue or graphical methods! could be used. In favourable cases 
with not many steps the calculation could even be performed with a 
slide-rule if need be. 

Case 2. The solution is wanted for a long interval (or for a short 
interval with higher accuracy). Here, even if quite low accuracy is 
sufficient in the solution, the calculation must be very accurate and 
should certainly be based on one of the more accurate methods such as 
the finite-difference or Runge-Kutta methods. Moreover the accuracy 
to which we work must be substantially higher than that to which the 
results are required (for example, two or three additional decimals, the 
so-called “guarding figures’, must be carried); consequently a slide-rule 
is no longer adequate and the calculation has to be carried out with 
the aid of a calculating machine. Also it is essential to exercise the 
utmost care at the beginning of the calculation to guard against the 
introduction of avoidable errors. 


1.3. Some general observations on error estimation 
for initial-value problems 


If approximate values y, of the solution y(x) of the initial-value 
problem (1.1), (1.2) have been calculated at the points x, by some 
approximate method, then the question of the magnitude of the error 


&y =, — (%,) (y = 4, 2,...) (1.4) 

1 WILLERS, Fr. A.: Graphische Integration, pp. 45— 104. Sammlung Géschen. 

Berlin and Leipzig 1920. — Methoden der praktischen Analysis, 2nd ed., p. 327 et 

seq. Berlin 1950. — Sanpen, H.v.: Praxis der Differentialgleichungen, 3rd ed., 

pp. 6—18. Berlin 1945. — Kamxe, E.: Differentialgleichungen, Lésungsmethoden 
und Lésungen, 3rd ed., Vol. I. Ch.A § 8. Leipzig 1944. 
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is of great importance. It might at least be possible to estimate the 
order of magnitude of this error ¢, and find out how many decimals 
can be safely guaranteed in the results. 

While we possess simple and useful error estimates for many problems 
in other spheres of practical analysis, we are still far from possessing 
such estimates for initial-value problems, at any rate as far as integra- 
tion over anything but a very short interval (with only a few steps) is 
concerned. For many methods — the finite-difference method, for 
example — rigorous limits have been established for the error, but fora 
large number of steps these limits are usually so wide that they far 
exceed the actual error in magnitude and hence their practical value is 
illusory. 

This difficulty is fundamental. It can even happen that approximate 
methods fail completely so rapidly do the errors grow, as the example 
(1.3) shows, and since a strict upper bound for the error must cover 
all cases, including the most unfavourable, we cannot expect it to give 
an accurate estimate of the magnitude of the error in a favourable case 
where the error remains small. Probably better limits will be established 
only if, instead of considering general differential equations such as 
y —/ix, yimorey = f(x, v, 9"), we treat each case on its merits so that 
we can use special properties of the function f/. Nevertheless general 
error limits are derived in §§ 1, 4 and 5 in order to exhibit the underlying 
principles on which other error limits can be based. 

Thus for integration over long intervals, we must usually be satisfied 
at present with “‘indications’’ of the actual error. Such indications are: 


I. Comparison of two approximations with different lengths of 
step. If we perform the calculation with a step h, obtaining approximate 
values y,, ¥o,-.. at the points x,=x)+ph, and then repeat the cal- 
culation with a step h, say h=2h, obtaining values ¥,, ¥g,..-, Vp 
corresponding to the previous values yo, V4,.--, Yop, differences d,= 
Yap— Vp Will be revealed. 

We now define a certain order k of an approximate method. Assuming 
that the values y,, yo,..., ¥p are exact, i.e. y,=y(x,) for v=0,1,...,p, 
we calculate y,,, by the method in question. If we now expand y (x, 41) 
and y,,, into Taylor series based on the point 7= x, thus 


= D hee 
Y (p41) y (Xp) +=. y (%,) + ae (x) +e, 
2 
Yori = Y (Xp) + tate 


there will be a last term whose coefficient is the same in both series. The 
corresponding exponent of h is called the order & of the method; thus 


dy = 9" (5), 00+, 4_ =" (xp), but agi yhrt(x,). (1.5) 
4* 
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It is customary to reason (by no means rigorously) as follows: in the 
first calculation, with a step length 4, an error proportional to hi eis 
introduced at each step, so that at the point =% +2h the error is 
A xX2nh*+1= A(E—x,)h*, where A is a constant of proportionality; and 
in the second calculation, with a step length 2h, an error proportional 
to (2h)*+ is introduced at each of the steps up to the same point &, 
so that the error is A xn(2h)**1= A(E— x) 2*h*, where A is the same 
constant of proportionality; thus we assume that approximately 


y(E) © Yan — A(E — %9) ht 5, — A(E — x) 241". (1.6) 
Solving for an approximate value of A, we find the error in the calculation 
with the small interval to be one (2*—1)-th part of the difference bet- 
ween the results of the two calculations: 


A(E— 2%) Whe Fe 708 and —y() aq — 2 ®, (4.7) 


Il. The terminal check. Here we calculate the values 
ib —1 Gree = ae ae ») (1.8) 


from the approximate solution and use them in the approximate evalua- 
tion of the repeated integral in the formula 


y (x x) = Yo+ Vole — 4%) + yy PAM 4 .. + lt a fi 
* &, &, (1.9) 
i Sei (4, (EF) ea) (n— *) (E,) \ahpigumedey, 


which is eee by repeated integration from (1.1), (1.2) (it may be 
added that most of the values /, would have been found during the 
original calculation, anyway). Provided that we use a sufficiently 
accurate quadrature formula, the value for y(x) obtained from (1.9) 
will be more accurate than that obtained in the approximate solution; 
it is then usually assumed that these values agree with the exact values 
to the same accuracy as that to which they agree with each other, an 
assumption which is not proved of course. For practical application of 
this type of terminal check, see § 2.5. 


1.4. Differential equations of the first order. Preliminaries 
Consider the differential equation 


U 


y= a2 =/ (7,9). (1.10) 


Let /(x, y) be a given continuous function in a domain D of the real 
(x, y) plane; for certain considerations we will assume that it is bounded 


in D, i.e. ‘ 
f(x, »)| SM in D, (4.41) 
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and satisfies a Lipschitz condition there, i.e. there is a constant K such 
that for all pairs of points (x, y,), (%, ¥,) in the domain D we have 


|# (x, 1) — f(%, ¥e)| S$ Ky, — yo]. (4.12) 


We require that solution y(x) of the differential equation (1.10) in 
the domain D which passes through a given initial point x =x), y=yy 
(Fig. II/4); in actual fact we require an approximation to this solution, 
i.e. we have to calculate approximations y, to the values y(x,) of the 
exact solution at the points x, (n=1, 2,...). 
The difference A x, = x,,,, — x, is called the step 
length or simply the step; it is usually denoted 
by # and is always taken to be positive. It 
often suffices to keep h constant (i.e. indepen- 
dent of n). 


Many methods are based on the equation 


oat Fig. II/1. Solution of a differen- 


y(%_43) = y (x,) = (aes y (x) dx, (1.13) tial equation of the first order 


which is obtained from (1.10) by integration, the integral on the right 
hand side being replaced by some approximate expression }. 


1.5. Some methods of integration 


We discuss briefly a rather crude approximate method — a summa- 
tion method — which would be used only when no great accuracy is 
required and only a small number of 
integration steps are involved. In this yi 


method, which we may call the “‘poly- g 

gon” method, formula (1.13) is used va \ton" fae 

in the crudest possible way: / is as- ; eye vr 
sumed to be constant at its initial Za wot e || In 


value 7, over the step interval <x,, 
%n41>- Thus we calculate the next y,., Yne7 


from y, by the formula Yn Sarg 
h Viti =a t Ala, (1.14) | 
where | = 
Ln =1(%n> Yn) (1.15) — Tn+Z nee F 
Somewhat more accurate is the “‘im- Fig. 11/2, The improved polygon method 


proved polygon method” in which we 
use the slope at an intermediate point (see Fig. II/2): we find an 


1 The basic idea was used by LEONHARD Ev Ler: Institutiones calculi integralis. 
Petersburg 1768—1770, published in Leonardi Euleri Opera omnia, series prima, 
Vol. 11, Leipzig and Berlin 1913, pp. 424—427; Vol. 12 (1914) pp. 271—274 (in 
Latin). 
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approximate intermediate point 


ig Fetes Ing Int Zhe (1.16) 
by using (1.14), (1.45) and then replace the /, in (1.14) by 
fry =P (%n49> Yuta)» (1.17) 
thus obtaining the improved approximation 
Ini = Int bheay (1.48) 


In the “improved Euler-Cauchy method” we first of all define 
rough values at x,,, by 


Farr =V¥n FA bee a) (1.19) 


and then use the arithmetic mean of f, and 


fyi aS an intermediate slope (see Fig. II/3). 
In this way we obtain the approximation 


Yuan (tnt Fass) (0080) 


DvuFFInG’s method! is based on formula 
(2.59) of Ch. I. The interval <a,b) now be- 
comes <x,,%,4,>, the function f(x) becomes 

tr tn+1 XZ  y(x), and f’(x) becomes y'(x) =/[x, v(x)]. If 
Fig. 13. a neglect the remainder term, we obtain the 
; approximate equation 


Ril. . j 
A(X. ¥)] 
la TX.) 


2h ; 
Ui tgs mm) ¥ 


by ZH(Kne My - ara ar + 3 Vis " vy) rT if 
In general, v, being already calculated, this is a non-linear equation 
for ¥,,-, and is usually solved iteratively: an estimated value of y,., 
is first inserted in the right-hand side, which then vields a new value 
of y,+4, (see also Ex. 3 in § 5.10). 

LoTKIN? goes one step further in this direction and proposes as an 
accurate method the use of the Euler-Maclaurin quadrature formula in 


? DuFFine, G.: Zur numerischen Integration gewohnilicher Differentiaiglewhun- 
gen 1. and 2. Ordnung. Forsch.-Arb. Ing.-Wes. 224, 2% s0 (1020). The derivations 
and improvements of DuFFING’s method given here are to be found im E. Pruanz: 
Bemerkungen uber die Methode von G. DuFFING zur Integration ven Ditterential- 
gleichungen. Z. Angew. Math. Mech. 28. 107 —172 (1048). The methed is extended 
by E. Beck: Zwei Anwendungen der Obreschkotischen Formel. Z. Angew. Math. 
Mech. 30, 84—93 (1950). 

? LotkKIN, M.: A new integrating procedure of high accurey. J. Math..,Phiws. 


31, 29—34 (1952). 
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the form (with b—a=h) 


here the remainder term R is of the seventh order. Starting from an 
approximate value 


h2 é h3 a? 
yOll=y, +h, aber ee b == Tale ) 


which determines the starting values /!°),, f°}, #7", we calculate suc- 
cessive iterates y!?), from the formula 


1 Gf ey+ 2 ER. 


120 


o h a 
wea» hy tht & 
Implicit in the presentation of this method is the assumption that 
f'=dfidx—=f,+f},f and /’” may be calculated sufficiently easily. 


Another method, which is sometimes effective also for differential 
equations of higher order, is to replace the differential equation by a 
simpler one solvable in closed form; for example, we can often obtain 
an approximate solution by replacing variable coefficients by piecewise- 
constant coefficients}. 


A simple example 
The initial-value problem 
2% 
yay a" y(0)=4 (1.24) 
possesses an exact solution, namely 


y=2%+4, (4.22) 


so that we can immediately assess the accuracy of the approximate methods for 
this particular case. Application of the approximate formulae (1.14) to (1.20) is 
so straightforward that the modus operandi is self-evident from the tables repro- 
duced here. 

Table II/1 gives the working for the improved polygon method with k= 0:2. 
As can be recommended for other calculations, we have indicated at the head of 
each column, numbered f1),(2,, 8), ..., how its contents are obtained from pre- 
viously calculated numbers in other columns; once this has been done, the caleula- 


1JIn the case y’=f(y), for example, f(y) can be replaced by linear functions 
over suitable intervals in y; then an approximation for y can be obtained by 
piecing together the solutions obtained in these intervals. Cf. K. KLOTTER: 
Technische Schwingungslehre, 2nd ed., Vol. I, p. 154. Berlin-Goéttingen-Heidel- 


berg 1951. 
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tion can proceed in an entirely systematic fashion without further reference to 
the formulae. This facilitates the actual computation considerably and renders it 
suitable for an assistant. 


Table II/1. 


Numerical integration of a first-order differential equation by the 
improved polygon method 


—0°36364| 0-183 64 

0-2 | 1:18364 |—0-33794 | 0084570 | 1-26821 0:3 —0:94622| 0-15902 | 1-34266 
0-4 | 1*34266 | —0-595 83 | 0074683 | 141734 0°5 —1.41109| 0:14236 | 1:48502 
0-6 | 1:°48502 |—0-80807 | 0-:067695 | 1°55272 0°7 —1°80329| 0:13021 | 161523 
0°8 | 1:61523 |—0-990 57 | 0:062466 | 1:67770 0-9 —2:145 80} 0°12096 | 1°73619 
1 1°73619 |—1-15195 | 0°058424 | 1:79461 ios] | —2°45178| 0:411374 1.84993 
1°2 | 1:84993 |—1:29735/0°055258| 1:90519 423 —2'72939| 0:10810 1:95803 
1°4 | 1:9580 |—1-4300 |0°:05280 | 2:0108 eG — 2:9838 0°1038 2-061 8 
1°6 | 2.0618 |—1°5520 |0°05098 | 2:1128 1°7 —3:2185 0:1007 | 2:1625 
1°8 | 2:°1625 |—1-6647 |0:04978 | 2:2123 1-9 | —Seqsiois 0:0989 | 22615 
2 2:261 5 


In order to compare the accuracy obtained by the various methods, we have 
carried more decimals than would otherwise be significant. 


Table II/2 shows the corresponding calculations for the improved Euler-Cauchy 
method with the same step length h=0-2; herethe integration is taken only as 
far as the point *= 1. 


os 


Table II/2. 
Numerical integration of a first-order equation by the improved Euler-Cauchy method 


h ~ 
7 yams Vat 


— 0°33708 
O25 9555 
—0°803 36 
—0°9829 


0-1 


(2)+(3) 
= 


0:084.959 
0-075 499 
0:069.036 
0-064 50 


122 
135658 
1°499 32 
1-631 79 
1°7569 


O22 
| 0-4 
| 0-6 
| 0-8 
1 


== 033333 
—0°58972 
— 0:800 36 
—0-980 52 
— 111384 


0°7669 
0-6990 
0°6513 
0°6185 


0°18667 
0°16165 
014540 
0°13416 
012635 


1°18667 
1°348 32 
1°49372 
1-627 88 
oS 
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In Table II/3 comparison is made with the exact solution (41.22) and also with 
results obtained by using the more accurate methods discussed in §§ 2 and 3; 
below each result the error is written in brackets (the error in an approximation 
€ to a true value x is defined as & — x). 


Table I1/3. Comparison of results obtained by various methods 


Improved 
Euler-Cauchy | polygon 
method 


Central-difference 
method 


Exact solution Runge-Kutta method 


Vex+1 


h=0-2 h=0-4 


1-183 2160 1-18667 1°183 64 1-183 2293 1-183221 5 
(+0°00345) | (+0-00042) (+0:0000133) |(+0-000005 5) 

0-4 | 1°3416408 1°348 32 1°34266 1°342066 1°341 6669 1:3416491 
(0-006 68) (000102) |(+0-000425) | (00000262) | (0:000008 4) 

0-6 | 1:-4832397 1-493 72 1°48502 1°483 281 5 1-483 2508 
(0:0105) (0-001 78) (0:0000418) | (0:0000114 1) 

O-8 | 1°6124515 1°627 88 1°615 23 1:613449 1-6125140 1°6124665 
(0-015 4) (0-002 78) (0:000997) | (0:0000624) | (0-0000149) 

4 1°7320508 1:7543 1°73619 1°7321419 1:7320713 
(0-022 33) (0-004 14) (00000911) | (0:000020 5) 

4°2] 1-8439089 1°84993 1-84600 1-8440401 1843937 
(0:00602) | (0:00209) (0-000 131) (0000028) 

1.4 } 1-9493589 1:95803 1-949 547 1-949 398 
(0-008 67) (0-000 188) (0-000 039) 

1:6 | 2-0493902 2-061 84 2:05367 2-049 660 2:049445 
(0:0124) (0-004 28) (0-000 270) (0000055) 

1°8 | 2-1447611 216252 2:145 148 2:144 839 
(0:017 8) (0-000 387) (0-000 078) 

2 2:236 0680 2:261 45 2-244 86 2:236 624 2:236179 
(0-025 4) (0-007 89) (0-000 556) (0-000 111) 


The Runge-Kutta method involves about twice the amount of work per step 
as the central-difference method so that it is reasonable to compare the Runge- 
Kutta results with h = 0-2 with those of the central-difference method with 4 = 0-1. 


1.6. Error estimation 


We assume here that the function /(x, y) in the differential equation 
(4.10) is bounded as in (1.11) and satisfies the Lipschitz condition (1.12) 
in the domain D as in § 1.4 and also that it possesses bounded partial 
derivatives in so far as it satisfies the conditions 

af(x,y) | _ | ef ly ee tae | a? fe 
ete ty 2h my 


_ Se|SN, (b= 1,2)...). (4.23) 


For simplicity we will ignore rounding errors in obtaining the follow- 
ing error estimates, i.e. we estimate only the “inherent” or “truncation”’ 
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errors. Rounding errors will, of course, be propagated throughout the 
calculation, but we take the view that, knowing an upper bound for 
the inherent errors from one of the error estimates, we can calculate 
with a number of decimals sufficient to ensure that the rounding errors 
remain within this bound. In principle it would not be difficult to 
derive similar estimates for the rounding errors. 

We define the “error” in the approximate value y,, to be the quantity 


En = Vn — V(%n)5 (1.24) 


from (1.13) the error increment 4¢, over one step is therefore 
eed 
Ae, = nt — En =In4i— In — J t(%, y(x)) ax. (1.25) 
IV %s 
The expression for the difference A y, is characteristic of each individual 
method, and further analysis in which we insert this expression into 
(1.25) must be referred to specific methods. 


I. Polygon method. From (1.14) the expression for Ay,, is 


Ay, =htn: 
therefore, with F(x) =j[x, y(x)], (1.25) becomes 
Ae, =h(f,— F(,)) + Jn, (1.26) 
where A 
J, =hFlx,) — fF) dx. (1.27) 


Since we have assumed that f(x, y) satisfies the Lipschitz condition 
(1.12), limits for the first term on the right of (1.26) can be obtained from 


fn — F(%,)| =|f(%n>Vn) —PXn V(% (x,))| SK ly, — v( igy)| ey. (1928) 
For the second term J, we first transform the integral by mai: 
by parts: 
An+1 Yat 
[A-Fls) dx = [le — aya) FYBH — f (tua) ae: 
4 34 
it then follows that ; 


(1.29) 


where JN, is as defined in (1.23). 
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Taking absolute values in (1.26) and using (1.28), (1.29), we obtain 


: | 4e,| =|e,41— &,| SAK|e,| + 4H, 
and since 


lengua — é,,| = rel _ | e,.| , 
we atrive at the “recursive error estimate” 
lensa] S (1 + 4K) ey] +4 MM. (1.30) 


Thus if an estimate for ¢, is known, ¢,,, can also be estimated. 


We can now easily derive an ‘‘independent error estimate’, i.e. one 
in which limits for |e, ,,| are determined without knowledge of limits 
for the preceding errors. The inequality (1.30) has the form 


| €n¢2| Sa@le,| +2, where 220,520, &=0, (n =0,1,2,...). (1.34) 


Consequently 
|e,| S23, \e.] Sale| +oSd(4 +a), 


and in general, as can be proved immediately by induction, 


b(a* — 1) 
a—-1 — 


le.) SOQ +a+a2?+---pa") = 
We have assumed here that a+1. 


(1.32) 


If we now insert the values a=1+hK, b= $h?N,, corresponding to 
(4.30), we obtain, for A >0, the independent error estimate 


fy 


l|é,|S 2K 


Mey ey — 1). (1.33) 


Since 1+-u<e“ for u>0, we can also use the estimate 


AN, = 
| en < = (eX(*m %o) __ 4), (4.34) 
where 7h has been replaced by x,,— x). From this it follows in particular 
that at a fixed point x, the error limits tend to zero as h->0, 1.e. the 


method is convergent. 


1.7. Corresponding error estimates for the improved methods 


II. Improved polygon method. We follow the same reasoning here 
so we may be brief. In this case the expression for Ay, is, from (1.16) 


to (143), 
: AVn =IVnga— Vn = AE Knays ame lel 
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and hence (1.25) becomes 


Ae, =h®, + Jr, (4.35) 
ee = Hie ee 
and ae 

J# =hF (i145) — J F(x) dx. (1.37) 


For the bounds of ®, we employ the Lipschitz condition (1.12) again: 


|®,,| a K\y,, ze EAT (Ky; Vn) iy ¥(Xn44)| 
=K|yn— y(%q) FEAT Xn» Yn) — Fl%n)] — Ly na) — Yn) — 2 AF (Xn) ] 


formula (4.29) applied over an interval of length $/ yields 


SAF (24) — (yaa) — 9(%)]) SM (G) 3 


hence for ®, we have the estimate 
- |G, |S Kf{le,| + 34K |e,| +37 Ny}. (1.38) 
For the quadrature error J* there are the known! bounds 
* i 
\ Jn |s37™. (1.39) 


where N, is as defined in (1.23). Consequently from (1.35), (1.38), (1.39) 
it follows that for K>0 


lenail —le,|S|4e,| SAK {1 +434K)le,|+4/°N,}4 9 ABN, 


(4.40) 
ie. fenuilSfe|{1 +2K + 4/7 K} + 4A8(KN, +4). 

This recursive error estimate also has the form (1.31), and using 
(1.32) we immediately obtain the independent estimate 


(A+hK + 5h? K2)"— 14 


1+4A4K (Aaa) 


len S 5 (M + 2] 


As with the polygon method the convergence of the method follows 
directly from this independent error estimate; here, however, the error 
at any fixed point x tends to zero like h? as ho. 


III. Improved Euler-Cauchy method. Proceeding exactly as in the previous 
case, we have from (4.19), (1.20) 


At,=h¥,+ jf*, 


1 See, for example, R. Courant: Differential and Integral Calculus, 2nd ed., 
Vol. I, p. 347. Glasgow 1937. 
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where 
ae P= Uf (ns Yn) + fnti Int Ain) — F(%q) — Fl%n41)] 
Fi n+. 
Je* = ah F(4q) + Fl%n41)] — f F(x) dx. 
xn 
From the Lipschitz condition it follows that 
| Fn] Sa K(| en] +19 (n+) — Yn — bf (%ns Yn)|)- 


Now? by Taytor’s theorem there is a point x=&, in (4p, ¥n44)> such that 


y (ns) — In — BE (ms Yn) = 9 (n) + HY (ay) +E) — 
~ Yn — E(u, Yn) = — en + BU ns Val) — Fem Yad + 9nd, 
and hence, since |y’(&,)|<.N, from (1.23), we have 
[9 (nts) Yn — BE Hm Yul] S60] + 4K eg] + AN. 


For the quadrature error /j,** in the trapezium approximation used in this 
method there is the well-known estimate 


[Jet] SPM. 
Altogether, we have 


hk nh? 
|en+al—lenl SA eu] SA] %l + Ltt] SS (lenl 2+ 4K) + 5M) + 


i.e. 


x 


= 
ioe’ 


h? k2 
2 


4 
[ental Sleal(t+4K+ 72>) + (KM + 2M). 

Again the recursive error estimate arrived at has the form of the 
inequality (41.31) so that the independent estimate can be immediately 
written down from (1.32): 

h? N, \ (1+AK+4h2 K2)"—14 
lens (™ + +) ate 


(1.42) 


These limits are precisely twice as wide as the limits (1.41) for the im- 
proved polygon method. 


Once more we can infer the convergence of the method. In this case also, the 
error limits at a fixed point x tend to zero quadratically as h—0. 


§ 2. The Runge-Kutta method for differential equations 
of the n-th order 


The Runge-Kutta method is a much-used method for accurate integration. The 
general formulae derived in §§2.1—2.3 by some rather laborious calculations need 


1 The estimate given here constitutes a sharpening of the estimate given in 
the first German edition; I am indebted for it to a written communication from 
Dr. WILLY RIcHTER, Neuchatel. 
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not concern the reader whose interest lies chiefly in the numerical integration of 
specific problems; he will find the computational formulae for equations of up to 
the fourth order collected together in § 2.4. 


2.1. A general formulation 
Suppose that the #-th order differential equation 
J) = FHI 7 Ws oe YO) (2.1) 
is to be integrated subject to prescribed initial values 
yl?) = (x) (vy =0,1,2,.-.,% —A) (2.2) 


at the point x =x). Approximate values will be derived for y and its 
derivatives y) at the point x,—=x +h one step ahead. 


Rough approximations can be obtained by using the prescribed 


initial values in Taylor series truncated at the terms in yi"~"): for y{" 
we have the value 
@) 2 yotay 1 WP tay RET time 
YooF gp Yor tap Yor + i, — ne pled 


the notation 7) being defined, somewhat more generally, by 


Enea i? 
T(a) = yf) + SF ygty 4 SAE yore po 4 | 


(xh)"—*-1 (4-1) 


(n—v— 1)! 7° 


7 =0,1,2,...8—1).| 


In order to obtain better approximations we add corrections to these 
truncated Taylor series; we derive quantities h, kh’, k’,..., k(">" such 
that the approximation 


! 
gid! ces ¥en Gre > k*”) — (y =0,4,...,% —1) (2.4) 
to the »-th derivative y)(x,) is as accurate as possible (the factor »!h7” 
will be found convenient later). 


First of all we describe a general formulation which includes many 
well-known numerical methods of integration as special cases. 


es : 5 : : : 
The “corrections” k) are expressed as linear combinations 


ke) = Li Yrake (v =0,1,...,% —4) (2.5) 
e= 


of certain auxiliary quantities ,, ky, ..., k,; these are defined in terms 
of the values of the function / at intermediate points in such a way 
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that they can be calculated successively: 


hy = ~~ (%, Ty(0), G0), -.-. G10), 


ka = Gs + ah, Ty (oy) + ao%, T(r) + ai',.--, 
fea) a, 4-1) , ee 
fn =< f (xp ctiog hn Tale) daoh, + broke, ---. 
T,,—1 (%—) + Ae n—1 hy t+ be n—1 ks) . 


From the definition of the T7)(«,) we know that the r “points” 


%=%y+ah, y= THe), y=F(a,),-...y¥" = T_1(@) 


(o=1,...,7) of the (x, y, y’,..., y-)) space lie near the true solution. 
Wie constants «, @,,,0,,,---, Vy. are at our disposal for making the 
Taylor series for the y{’) coincide with the Taylor series for the y® (x,) 
to as high an order as possible, i.e. for making the power of / in the 
last identical terms as high as possible. With the notation of (2.3) the 


Taylor series for y')(x,) can be written 


A” Rr—rtt 


(») = EA ies (n+1) - 

y Pa) ee) eee 0 cia (esa tee 
= julie a” yi) n+4 prtl y+) : 
eet) sie ‘6 ~ : rea |, 

which becomes 

(v) ars vy! [jn An n-+1 h* 

RAO eligi Ty om sh (2.8) 
n+2 yer? pet prt (Fi E/+H ppt : 
+I v a y a n—-1 n-2 


when the expressions (2.52), (2.53), (2.55) of Ch. I are inserted (when 
no particular argument values are specified for f, the values at the 
initial point x =x» are to be taken). We determine the k" as accurately 
as possible by choosing them so that when their Taylor expansions are 
inserted in the expressions (2.4), the latter coincide with (2.8) to as high 
an order as possible: 


me mlG ACS leer +(S rier! | 
ae wipe ES (n + 3) ee a 
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2.2. The special Runge-Kutta formulation 


Here we discuss the special case of the general formulation of § 2.1 
which gives rise to the Runge!-Kutta? formulae. These have found 
favour on account of their simple coefficients and symmetrical form; 
they are exhibited for differential equations of up to the fourth order 
in the tables in § 2.4. Some other formulae of Runge-Kutta type are 
collected together in Table I of the appendix. 

The basic idea due to C. RUNGE’ was applied to first-order equations 
in more accurate form by HEeun‘ and Kutta®$ and extended to second- 


1Cart Davip Totmét RuNGE, one of the most notable of German applied 
mathematicians, also known as a physicist through his investigations on spectral 
series, was one of the pioneers in the application of mathematical methods to the 
numerical treatment of technical problems. E. TREFFTz writes [Z. Angew. Math. 
Mech. 6, 423—424 (1926)] of him (translated from the German): “If RuNGE 
succeeded in bridging the gap between mathematics and technology, his success 
was due to two characteristics, which mark a true applied mathematician: his 
profound mathematical knowledge ..., and his unflagging energy in perfecting his 
methods with particular regard to their practical usefulness.”’ 

RUNGE was born in Bremen on the 30th August, 1856 and spent his early 
childhood in Havanna, where his father was in charge of the administration of 
the Danish consulate. From 1876 to 1880 he studied first in Munich and then in 
Berlin, where he took his doctor’s degree in 1880; he became an unsalaried lecturer 
at the University of Berlin in 1883 and was later, 1886, appointed as professor 
of mathematics in the Technische Hochschule, Hannover. From 1904 to 1924 he 
was professor of applied mathematics in G6ttingen, where he died on the 3rd 
January, 1927. 

His interests outside of scientific spheres were many and varied. He undertook 
several very lengthy journeys; in particular he accompanied SCHWARZSCHILD on 
an expedition to Algeria in connection with the solar eclipse of 1906 He also 
travelled to New York in 1909, where he was exchange professor in the Columbia 
University for the winter semester. Right into his old age he continued to engage 
in sports, gymnastics, swimming and rowing. Recalling some facets of his character 
L. Pranvtv [Naturwiss. 15, 227 —229 (1927)] writes (translated from the German) : 
“He was of a kindly disposition, yet strongly independent in his opinions, even to 
severe condemnations of that which appeared to him unfair or narrow-minded. 
With regard to himself he was extremely modest.” 

Details can be found in the biography by his daughter Irn1s RUNGE: Carl Runge 
und sein wissenschaftliches Werk. Géttingen 1949. 


? MARTIN WILHELM Kutta, born on the 3rd November, 1867 in Pitschen 
(Upper Silesia), studied in Breslau from 1885 to 1890, then went to Munich, where 
he took his doctor’s degree in 1901 and became an unsalaried lecturer in 1902. 
He spent 1898— 1899 in Cambridge. In 1910 he was appointed to Aachen and in 
1911 to Stuttgart as ordinary professor of mathematics (emeritus 1935). He died 
on the 25th December, 1944 in Fiirstenfeldbruck (near Munich), where he was 
staying with his brother. 

3 RunNGE, C.: Math. Ann. 46, 167—178 (1895) and Nachr. Ges. Wiss. Géttingen, 
Math.-phys. Kl. 1905, 252—257. 

* Heun, K.: Z. Math. Phys. 45, 23—38 (1900). 

5 Kutta, W.: Z. Math. Phys. 46, 435—453 (19014). 
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order equations by Nystrém!. ZuRMUHL continued the extension, first 
to third-order equations? and then to equations of the n-th order, 


In this particular formulation‘ we use just four auxiliary quantities 
hy, Ry, kg, ky. We choose a,=a,=4, a3 = 1, so that k, and k, are based 
on the mid-point of the step interval and k, on the last [k, is based on 
the first, being defined always as in (2.6)]. The a,,, b,,,... are chosen 
in an obvious way for k,: the additional terms in the arguments of 
merely extend the truncated Taylor series. For k, these constants are 
chosen so that the additional terms are calculated in a similar fashion 
but from k instead of k,. The definition of k, differs from that of k, 
only in the last argument of /, where &, is used instead of k,, so that 


k,=kg, when f does not depend explicitly on y*-». Thus 


maBifert, Belek. m(3)+() aay. 
T(z) + (2) grange 
he eee 
tillers. Bia)e. 8l5)+ (arty 
T(z) + (5) grote oe 
Taas(S)+(," 4) Gee, T(t) + As], 


1 
T(t) + (3) are 
Fat) +(," Jeo, raid +S4]. 


(For the practical evaluation of these arguments of / see § 2.4.) 


1 Nystr6M, E. J.: Uber die numerische Integration von Differentialgleichungen. 
Acta Soc. Sci. Fenn. 50, Nr. 13, 1—55 (1925). 

2 ZuRMUHL, R.: Zur numerischen Integration gewohnlicher Differentialglei- 
chungen zweiter und hdherer Ordnung. Z. Angew. Math. Mech. 20, 104—116 
(1940). 

3 ZURMUHL, R.: Runge-Kutta-Verfahren zur numerischen Integration von 
Differentialgleichungen m-ter Ordnung. Z. Angew. Math. Mech. 28, 173—182 
(1948). 

4 The general formulation of § 2.1 is pursued further by J. ALBRECHT: Beitrage 
zum Runge-Kutta-Verfahren. Z. Angew. Math. Mech. 35, 100—110 (1955). 

Collatz, Numerical treatment, 3rd edit., 2nd print. 5 
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2.3. Derivation of the Runge-Kutta formulae 


We now expand h,, k,, k3, ky into Taylor series based on the point 
(%p, Yor Yor ++ VK”). This is trivial for k, since it is already in the 
required form, but for the other k, the expansion presents a rather 
laborious calculation, for, in general, all the »+1 arguments of / are 
different from their values at x), as for instance, in 

fee h 


! h 
Fh =I (ro) Yot% S49,’ a ae + Vo 3-3! Seen f 


We shall continue the expansions of the required values of / only as far 
as the terms in /3. It may help the reader if we first work through a 
simple case, say with m =2: with y’=w and subscripts denoting deri- 
vatives of / we have 


he=tlet+S, vot putes, dc 


woe Gs + SA + Stet Fhe t (+ ty + 


16 
ee eee eee ae 


(Again all function values are evaluated at x= x, unless otherwise 
specified.) In general, using the notation of (2.51), (2.53), (2.55) in Ch. I 
and neglecting powers of /# greater than the third, we obtain the ex- 
pressions 


heath 
ty = 4 vt Di (Efi aDie § (F1-3D1 teal, 
a= ur lit 4 D+ © EH h DA + 
: (2.44) 
aa (FP+3DiDtya+3hpa(Ef — frsDf))| 
oehann ad Eft 
+ EFI E Staal P 1D fe Sebmgion||- 
The corrections ie kM, ...,R-» from which the new values of y 


and its derivatives y at x= oat will be calculated are now formed 
by linearly combining these four expressions for the k, as in (2.5). The 
coefficients of the combination are then determined By equating factors 
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of terms involving powers of # up to the (m+ 2)-th with the corre- 
sponding factors in (2.9); we find that 


from ae Voi + Yva + Mya + V4 = (*) ; 

from = Df = oat > Yes traa("F ‘) i , 

from a Ef Siat erat SMm= a EDGES , 
from _ f,1Df — SMa t Ze = 0- 


These four equations for the y,,,...,y,4 have the solution 


__ [n+ 2) (n — v)? 

m= ( ’ see 
a _ (*+2 2(n —v) 

Ya =a =( ‘ lee ess’ (2.12) 
_ [m#+2\ 2—(—») 

va | y Pees 


Substituting back into (2.5), we obtain the final expressions for the k”: 
Rt) — nN +2 a 
( v | ceomeryreree es | eas 
x [(m — »)?&y + 2(m — v) (Ay + Rg) -+ (2 — (ns — »)) Ra]. 


With these expressions for the k) and with the ’,, ky, ks, ky given 
by (2.11), let us now compare the next terms in the Taylor series for 
- y”) and ~ y)(x,), ie. the terms in A*+*®, The term from * yf is 


the term in (2.13) after substitution from (2.11), 1.e. 


fea i 1 : 
y } (n+1) (n+ 2) 


4-—q 4 1 3g 2-4 
pee len” arn Df + Ines I, 


n! 


a 4 


where g =" —v; the corresponding term from i y (x,) is the last term 
in (2.9), which may be written 


yn+3 n+2 r 1 * ™ 
( v Dreanice: 2) ¢g4-3 Ef ay i et ieee). 


n\ 
These expressions are identical if, and only if, g=1, Le. y=n—1. We 
have therefore obtained identity of the two Taylor series as far as the 
terms ain A’ for y, hy’, ...,—3 y"~*) and as far as the terms in 
et for ea), 


(n — 1)! 
5* 
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Thus, as a method for determining the ordinate y (cf. the remarks 
at the end of the next subsection), the Runge-Kutta method is of the 
(n +-2)-th order (in the sense of § 1.3) for »>1 and of the fourth order 
for n=1. Actually this assertion about the case »=1 does not follow 
immediately from our formulae, for they show only that the method 
is of at least the fourth order when » =1, but it can in fact be shown 
(which we do not do here) that the terms in /* in the Taylor series for 
y, and y(x,) are not identical. 


2.4. Hints for using the Runge-Kutta method 


For practical calculation it is usually more convenient to work with 
the quantities 


sy (v =0,1,...,% —1) (2.14) 


than with the derivatives y) direct and to transform the function / and 
the truncated Taylor series 7, correspondingly. We denote the initial 
values of the v, by 


v9 = = ~ yl) (2.45) 
and introduce the notation 
4! A — 1)! 
f (x. 4 Yr Uy Te Var eees ae 9-1} = "Our Ue. - tye), AG) 


eas 4 ‘ys 
t, (a) = = 1 (e) = 0,9 +0("* ) oy, ed B, £9 gee 


Se ae Lae (v=0,4,5..,% —4). ee 
With this new notation, (2.10) becomes 
Ey IDS, Ye. 9 Ph olan >in) 
aa Clee, 4 ae) eet 
tS) + ants ()oonete ala} 49 (a) Sala )+ (aa): 
ar O(rrhs » WB) ee ae) enth (248) 


2 eae) te a(S) + 9 (atale ala PP Gad) 


By = FP (ot hy toll) + hay (1) + hal”), ta(1) +5 (3)... 


tall) +44(,",), alt) +(,",)), 
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while the formula (2.13) for the corrections k®) remains unaltered. The 
new values 


U4 aa 1 
are then found from the transformed version of (2.4), namely 


v,,=4,(4) +k”, (2.19) 
We discern the following 


Computing procedure: First of all, the right-hand side of the given 
differential equation (2.1) and the initial values (2.2) are transformed 
by the introduction of the auxiliary variables v, of (2.14) into a function 
® and initial values v, 4, respectively, as in (2.16), (2.15). The values 
of ® needed in (2.18) for determing k,, k., ky, ky are calculated with the 
aid of the truncated Taylor series #,($), t,(1) defined in (2.17); then the 
corrections &”) are found from the k, using (2.13); finally (2.19) gives 
the new values v,,. These serve as starting values for the next step 
in the continuation of the solution. 

Tables II/4—II/7 exhibit the appropriate formulae for first-, second-, 
third- and fourth-order equations (coefficients for corresponding com- 
puting schemes? for m-th order differential equations where 5S”<10 


Table II/4. Runge-Kutta scheme for differential equations of the first order. 


y’ =f (%, ¥) 
* | y | Rky=h- f(z, 9) Correction 
Xp Yo | ky = 43(k, + 2h, + 2h, + Ry) 
to + th Ytthy hy 
tot th Yot he Rs 
th Yo t+ Rg Ry 
Hy= Ath | y=Yot+h 


Table II/5. Runge-Kutta scheme for differential equations of the second order. 
y"=t(4y, 9’) 


x y ! hy =n, hy fm ye ¥, 4) Correction 

eee 

Lo Yo Vio hy | hE G(R, t hy + &y) 

Xo tth Yot dry t+thy Yy9 + Ay hy | ; 

Hot Bh Voto t+ tA | 10+ Ae hg i kh! = 4 (hy + 2g + 2hy + fy) 

Hoth | Yot rot Ae Uy9 + 2h hy 
nC cee UU UE UEI EAI SI SUSIE SISOS 
2, =A th! Y= Vot ot y= Yo th’ 


1 ZURMUHL, R.: Runge-Kutta-Verfahren zur numerischen Integration von Dif- 
ferentialgleichungen n-ter Ordnung. Z. Angew. Math. Mech. 28, 173 —182 (1948). 


70 II. Initial-value problems in ordinary differential equations 


have been calculated by ZuRMUHL!). The actual calculations are best 


set out in tables of similar form. 


Table 11/6. Runge-Kutta scheme for differential equations of the third order. 
=e WIV) 


% y hy=y a y’=t, [ky=— x ais y, =, = 
Xo Yo V9 ©20 | ky | k 
Hoth |Yot3ryotSreot S| Mot Yo t th | rot ty | Ry | ke 
Hot EA |\Vot+Bryo+Sreo+ SA | Yo + Yoo + $A | Yeo + Zh, | hs | &’” 
Hoth |¥otVyot+V29+ hs Vin + 229 + 3%3| Yao t+ 3% | hy 
a= %+h| y= YotVyot Yao +h [Oy =%9+ 299 +h’ 


Log =V99-+h” 


where k = 95 (9h, + 6h, + 6F5— Ry), 
= hy t+ he + hg, 
Rh! = $ (hy + 2hg + 2hgt Fy). 


Table II/7. Runge-Kutta scheme for differential equations of the fourth order. 


YN te nv Vo) 
7 wae 
Xo Yo Vio 
1 : 
Assay Yo + 2%0 + 4% 29 + B00 + is’ Uy + 29 + F359 + BAY 


Yo t 9+ FU 29 + FU 39 + “e 
Vo + 9 + Vag + Vg9 + Fg 


) 3, es 
Vy9 + Ugg + ZU—9 + 2A, 
Yq + 2Vgq + 3Ug9 + 4h 


B= %+h Yy = Vot Yq + Vgq + Ugq + F Vy = yg + 2Vgq + 3Ugq + 2’ 
ia roe ib ee he v, 2, 6v 
) aes 7 dl Sus Ry "4 {a y h i | 
Vr 30 ky k 
Vag + $g9 + Shy Usq + 2k, ky | 
Vag + $09 + $y Uso + 2g ks | RY” 
Vag + 3Ug9 + Og Ugg + 4h ky ai 
Voy — Vag + 3 Ug9 + k’’ V3) a Ugo aa pier | 


where k = +5 (8h,+ 4h. + 4h, — hy), 
k’ =4$(9hk, + 6h, + 6hy — Ay), 
RY = 2(hy + hy + hg), 
Ri’ = 3 (ky + 2hg+ 2hy + hy). 
1 Similar schemes can be found in E. Buxovics: Eine Verbesserung und Ver- 
allgemeinerung des Verfahrens von BLAESs zur numerischen Integration gewéhn- 
licher Differentialgleichungen. Ost. Ing.-Arch. 4, 338—349 (1950). 
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Simplifications in particular cases. If the function f(x, y, y’,..., 
y"-») in the differential equation (2.1) does not depend explicitly on 
y~), then, as noted in § 2.2, k, =k,. In such cases there is consequently 
one less row to compute in the Runge-Kutta scheme. If f does not 
depend on some derivative, y" say, then only the end value v,, in the 
column corresponding to y'” need be calculated since the three auxiliary 
values between v,, and v,, are superfluous. 


Rule of thumb for the size of step length hk. A rough guide which is often 
used for finding a reasonable length of step is that h should be such that k, and 
k, are approximately equal; to be more specific, the difference between k, and hy 
should not exceed in magnitude a few per cent of the difference between k, and kp, 


otherwise a smaller step should be taken. The ratio hah is a measure of ‘‘sensi- 


1 
tiveness’ (cf. the “‘step index’’ S defined in § 3.4, which can also serve as a guide 


to the length of step for the Runge-Kutta method with n=1. S is approximately 
twice as big as the above measure of sensitiveness). 


Indications of the magnitude of the error. A satisfactory esti- 
mate for the error | y\”— y")(x,)| does not yet exist for the general case 
(cf. the remarks in § 1.3) but a rough guide which is often employed 
is provided by a comparison between solutions calculated with steps of 
length A and 2h, respectively, as discussed in § 1.3. For the case » =1 
the Taylor series for the approximation to y coincides with the Taylor 
series for the exact solution as far as the term in h?, so that, from (1.7), 
the error in the calculation with steps of length 4 should be roughly 5 
of the difference between the results of this calculation and those of 
the calculation with steps of length 2h. For the cases with »>1 not 
all the quantities y, y’,..., y'"~ are determined to the same order of 
accuracy at each step, but over a large number of steps it may be 
expected that the influence of the least accurately calculable derivative, 
namely y"~"), will determine the overall accuracy; since the method 
is always of the fourth order (§ 1.3, 1) for this derivative, we may 
still appropriately use the factor j, as long as no better error 
estimates exist. 

For the first-order equation y’=/(x, y) BIEBERBACH! has used a 
Taylor series expansion to establish the error estimate 

ye eat 


1 BIEBERBACH, L.: Theorie der Differentialgleichungen, 3rd ed., p. 54. Berlin 
4930. — On the remainder of the Runge-Kutta formula in the theory of ordinary 
differential equations. Z. Angew. Math. Phys. 2, 233 - 248 (1951); this paper also 
contains error estimates for »-th order equations (2.1) and for systems of first- 
order equations. Other error estimates have been given by E. Bukovics: Beitrage 
zur numerischen Integration, II. Mh. Math. 57, H.4 (1953), and J. ALBRECHT: 
Beitrage zum Runge-Kutta-Verfahren. Z. Angew. Math. Mech. 35, 100 — 110 (1955). 
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in which M and WN are numbers such that 

gitk 
ax! ay" 


N 
mi-1 


7@ey[(=—2, for 7 +kS3, |x —%|N<1 


in a domain |x — x%|<a, |y—¥9|<0 with azh and b>Ma. 


2.5. Terminal checks and iteration methods 


The incorporation of current checks? in the calculation is to be 
strongly recommended. A very good check is provided by a second 
calculation with a double-length step; it is best used as a current check 
(with the two calculations carried out concurrently) so that any errors 
which arise are noticed as soon as possible. In addition we can apply 
the following terminal check when the calculation has been taken as 
far as is required. First we construct the difference table of a convenient 
multiple of /, say h"f (this in itself may reveal some errors by a lack 
of smoothness in the higher differences); the differences can then be 
used in a finite-difference quadrature formula to evaluate the repeated 
integral occurring in (1.9). In general, differences of a sufficiently high 
order do not exist near the ends of the table, so that one cannot use 
the same formula throughout the table. 

In the case of a differential equation of the first order, for example, 
one would use the following formulae: 


at the ai of the table 


Xr +2 


Fides nd — 1) Bt Vef ug hit +, Ue ee SU het 
ty - (2.20) 


ae Ohs— sag tet eg Mle |, 
in the middle of the table 


*pt1 


[tax hlat t+ } ha gaat aig PYhas—--], (224) 


7 


756 


Xpant 


at the end of the table 


fiarmalr ~$04,-+04,-2 er. (2.22) 


Xpom1 


These are respectively formulae (2.11), (2.14) and (2.9) of Ch. I. 


1 Cf. E. LinpELGF: Remarques sur l’integration.... Acta Soc. Sci. Fenn. A2 
1938, Nr. 13, 11. — SanpeEn, H. v.: Praxis der Differentialgleichungen, 3rd ed., 
p. 29. Berlin 1945. 
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For differential equations of higher order, terminal checks can be 
applied in a variety of ways. For instance, instead of using formula 
(4.9), we could check all derivatives individually by using 


Y") (x, 44) = y")(x,) + f yor (x) dx (2.23) 


with y= and evaluating the integrals by the formulae (2:20) to’ (222) 
just quoted. 

Another way is to evaluate the integral in formula (1.9) by the 
repeated-integration formulae (2.30), (2.45) of Ch. I; thus at the begin- 
ning of the table we use 


Year © Y, thy, + yf! a 2 YneA°t, (2-24) 


and in the middle 


Vr oo = 


2, ae cae ar 


af for n odd, 
2h > bee he | 
e=0 


“age . (2:25) 


for ” even. 


If corresponding formulae are written down for each derivative 
occurring in the differential equation, they can be used as the basis of 
an iterative method of solution: if we have an approximate solution, 
say the v-th approximation, denoted by 


(»—1) [v) 


eg, VE 


we can, in general, obtain a better approximation, the (y-+-1)-th, by 
calculating the corresponding / values /) and using these in the right- 
hand sides of (2.24), (2.25) and the corresponding formulae for the 
derivatives which occur. 


2.6. Examples 


I. A differential equation of the first order. Consider again the 
example of § 1.5, i.e. the initial-value problem (1.21) 
D 2%, 
Vireo - 
We calculate a solution first with a step length h =0-2. The calculation 
for the first few steps is reproduced in Table II/8, in which an extra 
column is kept for recording the values of the auxiliary quantity 2%/y 
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needed in the calculation of h/(x, y). As far as the point x=0-6 the 
actual results of the calculation are distinguished by bold-face type; 
for steps beyond this point only the results are reproduced. 


Table II/8. A Runge-Kutta calculation for a first-order equation 


il 0 O-1 
1°14 0-181 818 0-091 8182 0-549 6877 
1-091 818 0-183 184 0-090 8637 0-183 2292 
1:181 727 0338488 0-084 3239 
; 1-183 2292 0°338058 0-084 517 1 
0-3 1°267 746 0°473 281 0-0794465 0-475 3128 
0:3 1°262676 0°475181 0:078 7495 0°1584376 
0-4 1°340 728 0°596691 0°:074 4037 
0-4 1.341 6668 0°596274 0-074 5393 
05 1°416 206 0:706112 0-:071 0094 0-424 8538 
05 1-412676 0°707 831 0-070 484 5 01416179 
0-6 1-482 636 0-809 369 0-067 3267 
0:6 1-483 2815 0°809016 0-067 4269 
0:8 1:6125140 0062028 2 
1 1°7321419 0:0577512 
1:2 1°844.0401 0°0542565 
‘eet 1:949 547 0-051 334 
1°6 2-049 660 0:048 846 
1°8 2°145148 0-046698 
2 2:236624 0-044 828 


For checking, and also for assessing the accuracy, the calculation is 
repeated with a double-length step h=0-4; the results are given in 


Table II/9. 


Table II/9. Corresponding calculation with a double-length step h = 0-4 


6) 1 

0:2 1:2 

0-2 N77 3) S845) 
0:4 1°332970 
0-4 1-3420658 
06 1-491 260 
0-6 1°479 380 
0°38 1:609 358 
os 1-613 4487 
1°2 1°84600 
1°6 2°053 67 

2) 2°244 86 


zi=0a(y-5)) 


(a) 0:2 
0: 333 333 0°173 3333 
0°340909 0°1664848 
0:600 164 0°146 5612 
0:596096 0-1491940 
0:804 689 0:137 3142 
0°811154 0:1336458 
0:1230346 


0:994 185 


Sk andk 


1:0261974 
0:3420658 


0°8141486 
0:271 3829 
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We now collect together (in Table 11/10) the results for the points 
*x=0-4Xk (k=1,2,...,5) and calculate corrections as in (1.7). Com- 
parison with the exact solution y = y2x+4 yields the actual errors in 
the values y obtained with #=0-2 and in the “improved” values 
[vy] =y — 6; the latter are seen to be considerably smaller than the former. 


Table II/10. Comparison of the accuracies of the Runge-Kutta solution and the 
improved solution 


Results of Runge-Kutta 
calculation with = 
ea (yey) 
k=0-4 15 


0-4} 1°3416669 | 1-3420658 | 0:0000266 | 1-3416403 | +0-0000262 | —0-0000004 
0°8 | 1°6125140 | 1°6134487 | 0:0000623 | 1-6124517 0:000 0624 | +0:0000001 
1°2) 1°844040 1°84599 0-000 130 1°843 910 0-000 131 -+0:000001 5 
1°6| 2:049660 2-053 64 0-000 266 2:049 395 0-000 270 0-000 004 4 
2 2°236624 2°244 80 0-000 545 2:236079 0-000 556 0:0000109 


II. A System of first-order differential equations. Here we consider the 
Euler equations for the motion of an unsymmetrical top (principle moments of 
inertia A, B, C) subject to a frictional resistance proportional to the instan- 
taneous angular velocity vector u,, u,, u,. With differentiation in time denoted 
by a dot the equations run! 


At, = (C — B) u,ug— er, 
Bu, = (A —C) ugu, — Etty, 
Cu, = (B— A) uu, — EXsg. 
If B=2A, C=3A, e€=0°6 A/sec., we obtain the system 
Uy = Ug tg— 06%, y= —UyUg—O'3 Ug, thy = FU Ug — 0-2 Ug. 


Let the initial angular velocity be given by 4,=1, t,.=—1, 4us=O at t=O. 


Application of the Runge-Kutta method occasions little difficulty. We have 
only to set up three schemes, one for each unknown, and it suffices to exhibit the 
first two steps with the step 4 = 0-2 and, for comparison, one step with the double 
length interval k= 0-4. This is done in Table IT/11. 


III. A differential equation of higher order. In the calculation of 
the laminar boundary layer on a flat plate parallel to a stream, the follow- 
ing boundary-value problem arises: 


1 See, for example, Handbuch der Physik, Vol. V, p. 405, Berlin 1927, or 
A. FoprpLt: Vorlesungen iiber technische Mechanik, Vol. 4 (Dynamik), 10th ed., 
p. 209. Miinchen und Berlin 1944. 
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2.6. Examples 


This may be reduced to the initial-value problem? 


ver 
po 


yy”, 


Owl) — 0, 


aes. 
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The Runge-Kutta calculations for 4 =0-5 are set out in Table II/12; 
for the steps from x=1 to x=} only the results are given. 


Table II/12. Solution of a third-order differential equation by RunGcE-Kutta 


0 0 0 0-125 @) e) 

0°25 |0-03125 0-125 0-003 906 3| —0-000651 0 | —0-001 2969 |—0-001 2969 

0:25 |0:03125 0-124 023 410-003 875 6| —0-0006459 | —0-005 1444 |—0:0025722 

O°5 |0°124354 4) 0-123 062 20-015 303 3) —0-002 5506 | —0-005 2308 |—0:000 261 5 

0-5 |0-1247385 0-248 703 1 0-122 427 80-015 271 5) —0:0025453 

0°75 |0°2793798 0-1186099 0-033 137 2) — 0-005 5229 | —0-010837 8 |—0:013 3831 

0°75 |0:2793798, 0114 143 5/0031 8894) —0-005 3149 | —0-0329269 |—0:016 463 5 
0°490 5545 0-106 483 110-052235 8) —0:008 7060 | —0-079228 5 |—0:003 961 4 

1 ‘0-491 908 0! 0-480 175 60-105 964 30-052 124 7) —0-008 687 4 

1°5 |1:067917 3) 0-660 5306/0-072 2886 —0°012 8664 

2 1-787924 |0°767123 |0-035606 —0:010610 

2:5 |2:581205 |0°811538 |0-:012286 —0:005 285 

3 3°400614 |0°824154 (0-003 316 — 0-001 880 


Table I1/13. Corresponding calculation with double-length step 


(9) 0 0 
0°5 0-125 : —0:020833 
0°5 0-125 | 0:468 750 —0:019531 
1 0°480469 | 0:441 406 —0°070694 
1 0-491 425 0-959 636 | 0-424 289 —0:069 502 
4°5 1:068 627 | 0:320036 —0:114000 
4°5 1-068 627 | 0:253289 —0°090 224 
2 1°785 126 0°153618 —0:091 409 
5 _ ——— - 2 
2 1-787377 _| 1-534 488 0-139609 —0-083178 
2:5 2°579126 0:014842 —0:012 760 
25 | 2:579126 0:120469 —0:103 568 
3 3°357 906 | 0171096 +0:191 508 
3 3-379570 | 1-614 200 0-077 446 
1 Mone, E.: Dtsch. Math. 4, 485 (1939). — SCHLICHTING, H.: Grenzschicht- 


Theorie. 483 pp. Karlsruhe 1951. — Modern Developments in Fluid Dynamics 
(ed=S? GoLpsTEIn), Vol. I, p. 135. London: Oxford University Press 1938. 
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For comparison the calculation was repeated with the double-length 
step h =1; this is exhibited in Table II/13, from which several auxiliary 
columns have been omitted. 

For the last step, from x =2 to x =}, an alternation in sign appears 
in the v, and & columns, indicating that the interval is much too large 
and that we can no longer have any confidence in the values obtained; 
these values for the point x =3 do, in fact, show a considerable deviation 
from those obtained by the calculation with the smaller interval. 


§3. Finite-difference methods for differential equations of 
the first order 


Among the approximate methods which exist at present, the finite- 
difference methods are the most accurate in general. Among these, the 
interpolation methods are superior to the extrapolation methods in that 
they give a considerable improvement in accuracy with only a moderate 
increase in the amount of labour involved. Consequently, interpolation 
methods are in far more extensive use nowadays than extrapolation 
methods. Of the interpolation methods, the central-difference method 
has several advantages over the Adams interpolation method: the 
computations are simpler, the convergence is more rapid and smaller 
error limits can be derived. Naturally only very general advice can be 
given to guide the computer in his choice of a suitable method. Finite- 
difference methods are very suitable when the functions being dealt with 
are smooth and the differences decrease rapidly with increasing order; 
calculations with these methods are best carried out with a fairly small 
length of step. On the other hand, if the functions are not smooth, perhaps 
given by experimental results, or if we want to use a larger step, then the 
Runge-Kutta method is to be preferred; it is also advantageous to use this 
method when we have to change the length of step frequently, particularly 
when this change is a decrease. Clearly we should not choose too large a 
step even for the Runge-Kutta method. (Cf.1 the remarks in § 2.4.) 


3.1. Introduction 
Suppose that the differential equation (1.10) 
yt 1 el) 
is to be integrated numerically with the initial condition y = y, at x = Xp. 
As in § 1.4, let the range of integration be covered by the equally spaced 
points %, %,,...,%, with the constant difference h=Ax,=x,,,—x, 


‘ MILNE, W. E.: Note on the Runge-Kutta method. Research Paper RP 2101, 
J. Res. Nat. Bur. Stand. 44, 549— 550 (1950), gives examples for which the central- 
difference method yields substantially better results than the Runge-Kutta method. 
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(the step length) and let y, be an approximation to the value y(x,) of 
the exact solution at the point x,. The finite-difference methods are 
based on the integrated form (1.13) 


Arty 


¥(%,41) = 9 (2,) and I(x, y(x)) dx (3.1) 


of equation (1.10), as were the crude methods of § 4.5, but here the 
integral is approximated more accurately. Suppose that the integration 
has already been carried as far as the point x =x, so that approxima- 
tions ¥,...,Y,-9»¥,-1, ¥,, and hence also approximate values /, = 
(x,, y,), are known. We now have to calculate y,,,. In finite-difference 
methods, formulae for doing this are derived by replacing the integrand 
in (3.1) by a polynomial P(x) which takes the values /, at a certain 
number of points x, and then integrating this polynomial over the 
interval x, to x,,,. This basic idea can be used in a variety of ways 
(cf. § 3.3)! but we always need to have a sequence of approximations /, 
before we can start the step-by-step procedures defined by the finite- 
difference formulae (see § 3.3) ; consequently the finite-difference methods 
have two distinct stages: the first is the calculation of ‘‘starting values’’, 
in which the first few approximations y,, y,,..., the “starting values” 
(we reserve the term “initial values” for values at the initial point 
% =X), sufficiently many to calculate the values /, required for the first 
application of the finite-difference formula, are obtained by some other 
means; then follows the main calculation, in which the finite-difference 
formula is used to continue the solution step by step as far as required. 
The starting values should be calculated as accurately as possible 
(cf. *§ete2)s 


3.2. Calculation of starting values 


The starting values needed for the main calculation can be obtained 
in a variety of ways. As has already been stressed, particular care must 
be exercised in the calculation of these starting values, for the whole 
calculation can be rendered useless by inaccuracies in them. 

We now mention several possible ways of obtaining starting values; 
anyone with little experience might restrict himself to the first two 
only to begin with. 


I. Using some other method of integration. Provided that it is 
sufficiently accurate, any method of integration which does not require 
starting values (as distinct from initial values) can be used. Bearing 
in mind the high accuracy desired, one would normally choose the 


1 The interpolation idea is used by W. QuapDE: Numerische Integration von 
gewohnlichen Differentialgleichungen nach HERMITE. Z. Angew. Math. Mech. 37, 


161—169 (1957). 
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Runge-Kutta method; further, one would work preferably with a step 
of half the length to be used in the main calculation and with a greater 
number of decimals. 


II. Using the Taylor series for y(x). If the function /(x, y) is of 
simple analytical form, we can determine the derivatives y’(% 9), y'"(%9), 
y'"'(%9), ... by differentiation of the differential equation (1.10); starting 
values can then be calculated from the Taylor series 
(vh)? 


y(t) be (3.2) 


y(%) = (te) + 2% y!(x9) + 


of which as many terms are taken as are necessary for the truncation 
not to affect the last decimal carried (always assuming that the series 
converges). 

Several of the finite-difference methods need three starting values, 
and for these it suffices to use (3.2) for y=-+1; this usually possesses 
advantages over using (3.2) for »=1,2, particularly as regards con- 
vergence. 


Example. For the example (1.21) 


‘ 2a 
Uae ae yO) 4 
of §1.5 we have 
yYy—yr+2x=0, 
Wy ty 27 9+ 20, 
VY yt 3 yy —2y y—2y72= ; 
Putting + =0 and y = 1 we obtain successively the initial values of the derivatives: 
W(O)=15 (0) = — 15 "(0 = 35 yIV(Q) = — 15; yV(0) = 105; 


[generally, y()(0) = (—1)"—1 x 1.3.5. ... (2% — 3) for »=2, 3,...]. With h=0-1, 
for example, we have the starting values 


VE Ol) aon 


2! {074)* + aa 


which to seven decimals are 
y (0-1) = 10954451, 


y (— 0-1) = 0:8944272. 
Ila. MILNE’S starting procedure. W. E. MILNE! has given formulae 


which bring in the derivatives at the point x,. They are obtained by 
eliminating y'Y (x9), vy” (%), y”'(%») between the Taylor series for y(x,), 


1 Mine, W. E.: A note on the numerical integration of differential equations. 
Research paper RP 2046, J. Res. Nat. Bur. Stand. 43, 537—542 (1949). 
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y'(x4), ¥""(%), v(x) truncated after the term in y¥!(x,). The result is 
the formula 


¥ (a) — 9 (me) = Dy (a) + 9'%0)] — Ly") — 940) + 


hs eat wer 
ao 120 [y "(a + y'"(%9)] + Re, 
where i? 
—— VII 
i 100800 (¢). 
The intermediate point & in this remainder term lies in the interval 
XySES%. 


This formula is applicable when the higher derivatives may be expressed in 
simple analytical form in terms of x and y. For the same degree of accuracy, 
fewer derivatives need be calculated than with method II but since y, appears 
on the right-hand side, the formula is an equation, rather than an explicit expression, 
for y, and for non-linear differential equations y, will usually have to be determined 
by iteration (cf. § 3.3 method II). The formula can also be used for the main 
calculation. If we also expand y(x,) into a Taylor series and truncate after the term 
in yY!(x,), we can derive in like manner the formula 


y (%_) — 2y(%) + ¥(%) = 7h [y"(%) — ¥’(%)] — 3h Ly" (%) + 9’(%)] + 
3 
+ 19") — 59a) + Go EB) 

III. Using quadrature formulae. Using formulae (2.11) and (2.14) 
of Ch. I, we build up rough values of y,, hf,, AV/,,... for the first few 
values of » and then improve them by an iterative process. Various 
schemes can be arranged for doing this; we give here a procedure! 
which is suitable for the construction of two (y,, y,) or three (¥,, V2, V3) 
starting values. The procedure is completely described by the following 
formulae (for two starting values, only the formulae framed in dots are 
needed and the B equations are to be used also for »=0): 


A. eit values. 


i Ate EL ” tise A=tlm A); Vi=h—-fe 
: i =Yot+h(fo+4Vi,), thence f", Vf, 
>. cf — Yo + ahi thence (9), Vis , 2712), 


4. yi Ee WG, + Lyf 2 prj, 
sf -— yo hCenO-a PAA), thence 0,778, A, PA) 
5. yl = yl) + h(a fh) + £7 2/%), thence f), 7/2), V2AY, 79/0. 


1 Other iterative schemes can be found in G. ScHutz: Interpolationsverfahren 
zur numerischen Integration gewdhnlicher Differentialgleichungen. Z. Angew. 


Math. Mech. 12, 44—59 (1932). — Tortmien, W.: Uber die Fehlerabschatzung 
beim Adamsschen Verfahren. Z. Angew. Math. Mech. 18, 83—90 (1938), in parti- 
cular p. 87. 


Collatz, Numerical treatment, 3rd edit., 2nd print. 6 
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B. Iterative improvement for vy =1,2,... (or y=O, 1,.--) 


My thf taV A — aM +a Vhs), 
Oe = yo WE) Me (3-5) 


yay phen +4779). 


Thus we alternately improve the three y values and revise the function 
values /!!=/(x,, y}”}) and their differences. This starting process should 
be carried out with a sufficiently small step length (see § 3.4). 


Table 11/14. Iterative calculation of starting values 


4. 0-1 | 0 0-01 0-01 | . 
(3.4) 2 2. 0-4 | 0-005 0:0105 0:0105 
3 0-2 | 0-024 0:0221 00116 | 0-0011 


(3.4) a 0-4 | 0005158) 0-0105158 0-010 5158 | 
3. ; 0:2 | 0-021 367 | 0°:0221367 | 0-0116209 | 0:0011051 


0:3 | 0049800} 0:0349800 128433| 12224] 0-0001173 
0-1 | 0-005170| 0:0105170 | 0-0105170 | 
y=2 {| 0-2 |0-021400} 221400 116230 | 0-001 1060 
a 0-3 | 00498514 349854 anal 12221 | 00001161 
ae) = , = 
5 0-1 | 0005474 41051714 105171 
3 v= 3 0:2 | 0:021 403 221403 116232 11061 ' 
8 0:3 | 0049858} 34.9858 12845 5 | 12223 | 1162 
Lam! eee Pere re ol | eS : i -— _ 
v=4 | 0:3 |0-:049859| 349859 128456| 12224 | 1163 


Example. With 4=0:-1 application of this starting procedure to the initial- 
value problem 


y=x+y, y(0)=0 


yields the numbers in Table II/14. The value of A is, in fact, rather large (cf. the 
remarks on the length of step interval in § 3.4); with A= 0-05 so many iterations 
would not have been necessary. 


3.3. Formulae for the main calculation 


We now describe how the next approximate value y,,, can be ob- 
tained once the values y,, y2,..., y, at the points x, %,,..., x, have 
been computed. 
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I. The Adams extrapolation method!?. In the “extrapolation 
methods’, which we consider first, the function f(x, y (x)) under the inte- 
gral in equation (3.1) is replaced by the interpolation polynomial? P(x) 
which takes the values /,_,,..., /,-1, /, at the points ee, Fai; 
[where /,=/(%,, y,)]. In effect we evaluate the integral by means 
of the quadrature formula (2.6) of Ch. I; thus, with y,,, and y, replacing 
y(x,4) and y(x,), (3.4) becomes 


p 
Vea ey =a h > p; as fs 
e=0 (3.6) 
me b eu Beeytp > ep = pay 
Yh + SOLAS +S +e), 
in which the £, are given generally by formula (2.7) in Ch. I. The exact 
solution y(x) satisfies the corresponding exact form 


pb 
Y (%p41) = 9 (%,) +hd Bo °F (Xs 9 (%)) + Spas: (3.7) 


(2.8) of Ch. I gives an estimate for the remainder term S,,,. 


There are occasions when the extrapolation formula (3.6) is used in 
a somewhat different form (sometimes called the “‘Lagrangian’’ form) 
in which the differences V°f, are expressed in terms of the function 
values 7,. If the terms involving each individual function value are 
collected together we obtain new coefficients «,, which depend on the 
number # of differences retained in (3.6): 


p 
Yr41 =I th Litpehro: (3.8) 
o= 


1 Joun Coucu Apams, the English astronomer, born on the 5th June 1819 in 
Laneast, became a Fellow of St. Johns College, Cambridge, and tutor in mathe- 
matics there; then in 1849 he was appointed Director of the Observatory and in 
1858 Lowndean Professor of Astronomy and Geometry in the University. He died 
on the 22nd January 1892 in London. He was one of the discoverers of the planet 
Neptune. As early as 1841 he tried to explain the perturbations in the motion 
of Uranus by the influence of an unknown planet and to calculate the orbit of this 
planet by first assuming it to be circular and then modifying it to elliptical form 
by deriving corrections from the perturbations of Uranus. In 1844 he communi- 
cated his results to Prof. CHALLIs and asked him if he would look out for the 
planet in the calculated position. 

2 BasHFORTH, F., and J. C. Apams: An attempt to test the theories of capillary 
action, p. 18. Cambridge 1883. 

3 Trigonometric interpolation polynomials are recommended by W. QUADE: 
Numerische Integration von Differentialgleichungen bei Approximation durch 
trigonometrische Ausdriicke. Z. Angew. Math. Mech. 31, 237 238 (M1951); ex= 
ponential sums are used by P. Brock and F. J. MURRAY: The use of exponential 
sums in step-by-step integration. M. T. A.C. 6, 63—78 (1952). 

6* 
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The values of the first few «,, are given in Table IT/15 (a check on the 


p 
calculation of the «,, is given by the relation } «,.=1). 
=0 


In onde to calculate y, ,, from 
(3.6) we need the values which 
are “boxed” in Table II/16. The 
values of /,V/,... associated with 
the function / are conveniently 
tabulated with the factor 4; the 
coefficients which we multiply 
them by in (3.6) are noted at the 
heads of the corresponding co- 
lumns. When y,,, 1s being cal- 
culated, all the numbers above the dotted line are known, and each 
further step in the calculation yields in turn another line of entries 
“‘parallel’’ to the dotted line. For convenience, the differences are often 
arranged as in Table I/2 so that this line of new entries is horizontal 
(cf. the example in § 3.5). 


Table II/15. The numbers ay, 


Table 11/16. The Adams extrapolation method 


x1 Beal x= Xn x= 
x & hf avi Apt Avs 
vy vrai Ce h Efe Loose eeseeeess 
[+77,] Vi, ‘ ; 
vy | ve | hf, |. eee S 
If we use the equation 
r+1 
Y (%,41) = (%,-1) + f f(x, y(x)) dx (3.9) 
Apt 


instead of (3.1) and, as above, replace the integrand by the polynomial 
P(x) which takes the values /, at x=, (@=r—p,...,7), we obtain 
NysTROm’s extrapolation formula 

1 


Vesa = Vath \2f-+ 3 ee VS} a i . Mire | 


=athl2tt § (Vt, +09, + VY, + 054) — (3-10) 


1 


ET 
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which follows immediately from (2.32) of Ch.I with w=1 (we have 
only to replace %_,, %, x by %,_1, %,, X41, respectively). If truncated 
after the term in 73/,, this formula has simpler coefficients than the 
Adams formula (3.6). The corresponding difference scheme is shown in 
Table II/17 with the values needed for the calculation of y,,, boxed as 
before. 

Table II/17. Nystr6m’s extrapolation method 


1 i 

x1 x2 = yi 

ar ase 

x ¥ hf hvVt hV?f hve 


II. The Adams interpolation method. Here the integrand / (x, y(x)) 
in the equation (3.1) is replaced by the polynomial P*(x) which takes the 
Wales) opts ~<a felisiysfeeg at te PONS 4%, _ 4145 21.5 Xo Mes Xp sa: 
Then from the quadrature formula (2.9) of Ch. I it follows that 


P 
Vet1 =, th oe, V° tit 
20 (3.11) 


1 1 1 
Sa ifrey i rt > Virsa res 2 Macs 34 TE 7) , 
where the f* are given generally by formula (2.9) of Ch. I. 


For the exact solution y(x : we have the corresponding formula 


¥ (X41) = (% )+adp% es f(x %y sa, V( %y+41)) ti Spat 


with remainder term S#,,, ~ which an estimate is given by (2.10) 
ot Ch, I. 

Formula (3.11) is also used occasionally in Lagrangian form cor- 
responding to (3.8): 


p 
Yi =I thd abohrts—o- (3.12) 
= 
The first few values of the «}, are given in Table II/18. 
p 
As with the a,,, here also we have the check eee Prem (2:7), 
(2.13) of Ch.I it follows that cs 


toe» (3.13) 
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The quantities which appear in (3.11) are indicated in Table II/19, 
where the finite-difference scheme is set out in the same way as for the 
extrapolation method. 


Table 11/18. The numbers af 


0 5 2 eri. x 
1 1 | 
at 2 2 
5 8 1 
(ee 2 = | > oo 
9 19 5 1 
Ps 24 24 ~ 24 24 
=4 251 646 264 106 | 19 
(i 720 720 720 720 720 


In the application of (3.11) the difficulty arises that the quantities 
depending on },,;=/(%,41, ¥,41) which appear on the mght-hand side 
are not yet known. Consequently the unknown y,,, appears on both 


Table 11/19. The Adams interpolation method 


| oa | x §) | ae) | Cael 


hf 


Ay 4 Vy—-1 hf, —4 a 


=< : a 


sides of the equation and only in special cases is it possible to solve this 
equation exactly for y,,,. Equation (3.11) is, however, very suitable 
for the iterative calculation of y,,, provided that h is sufficiently small. 
We put an approximate value ale) ain - =i -hand side, forming 


AD, =1(«, 41, lt) and the differences eS) = ee ry and 
then calculate 


p 
ya =y, +h LBV (6 =O) 2, ...) (3.44) 
e=0 
as the (o +-1)-th iterate. 


Ill. Central-difference interpolation method. If we integrate both 
sides of the differential equation (1.10) over the interval x,—h to x, +h 
using STIRLING’S interpolation formula, as in Ch.I (2.14), (2.45), we 
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obtain (with ~ even) 
pe 
Y (%,41) — ¥(%,a) =h 2 Be V*°F (Xp 40) I (%r40)) + Sp*. 
e= 


If the remainder term is neglected, we have an equation relating the 
approximations y,, namely 


p/2 


Veo te Oot h = ip is Bae 
ia (3.15) 


=h(2f,-+ = I hrs1— > v4 hast ae mals aac s+), 


Usually this formula is truncated after the term in V?, which gives 
SIMPSON’S rule: 


h 
Yr =VYearth(2t +5 ha)=%ats rats thn): 6.19 
An estimate for the remainder term S}* in the corresponding formula 


Y (Xe 4a) = ¥(%-1) + [24 (%,, 9 (%,)) +3077 (4,41, 9 (%42))] + sz* (3.17) 


for the exact solution is given by (2.18) in Ch. I. 

As with formula (3.11), (3.16) also includes the unknown y,,, on 
both sides of the equation, so that here also one determines y,,, iter- 
atively in general. — the next approximation y/%4") is obtained from 
the current value y!?), according to the formula 


We = 9,4 +h(2t, + 302A) - (3.18) 


The form of the tabular scheme for this method can be seen in 


Table I1/20. 
Table 11/20. The central-difference method 


eal x2 ore 

x y | hf | APT hos 

Vy vt igen | nV hV?}, 
. 


AViy+4 


M44 [> +1] Ahyty 


LINDELGF! has suggested a method based on formula (3.15) in which 
the term in V*/,,,is taken into account as well. He rewrites the equation 


1 LInDELOF, E.: Remarques sur ]’intégration numérique des équations dif- 
férentielles ordinaires. Acta Soc. Sci. Fenn. A 2 1938, Nr. 13 (21 pp.). He also 
gives a further refinement of the method. 
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in the form 
Vesa =VMith [24,+3(V77,+ V2 7} +6 
with 
b= 4 (V8 tear — 5 V4 besa), 


and then, assuming that the solution has already been computed up to 
the point + =¥%,, uses 


as =Vrpe1 th[2 hag + 3 (V7 frag + V? t44)] 


for 7 =0 and 7 =1 to obtain tentative values for the next two points. 
These are then used to build up the difference table temporarily so that 
approximate values of /4/,,, and V4/,,, are available for the correction 
6 to y,,,. The new value of y,,, extends the final difference table up 
to the point += %,,,. 


IV. Mixed extrapolation and interpolation methods. With the 
methods II and ITI, the 7,,, on the right-hand sides of equations (3.11) 
and (3.16), respectively, appears as an unknown as well as v,__, and must 
be either estimated or calculated from an extrapolation formula. MILNE} 
recommends the latter procedure. A rough value y7,, is calculated from 
an extrapolation formula, then /*,,;=/(%,11, ¥f.1) is formed and the 
difference table completed temporarily so that sufficient differences are 
available to determine y,,, from an interpolation formula. If need be, 
this value of y,,, can be still further improved by iteration using the 
interpolation formula?. In particular, MILNE gives the formulae 


h 
Vrva Seo + 4hf,_4 + = Vay, 


h 
Vet = Vyat 2hf, + 3 ye fess 


the second of which is the formula (3.16) of the central-difference method. 


3.4. Hints for the practical application of the finite-difference methods 


I. Estimation of the highest difference occurring in an interpola- 
tion method. If the requisite starting values have been obtained by 
one of the starting procedures described in §3.2, then, in order to begin 
the iterations (3.14) or (3.18), we must estimate /,,,; equivalently, we 
can estimate the highest difference occurring 1’ /,,, (P =2 for the cen- 
tral-difference method), which is much easier. Once the calculation is 


1 Mine, W. E.: Numerical solution of differential equations, p. 65. New York 
and London 1953. 

* A further variant is mentioned by P. O. L6wp1n: On the numerical integra- 
tion of ordinary differential equations of the first order. Quart. Appl. Math. 10, 
97—111 (1952). 
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properly under way there exists a series of values of V?f from which we 
can easily extrapolate for a good estimate of the next value by noting 
the trend of either the V?/ or V+! values. The better the estimate, 
the less work there is involved in the iteration. 


II. Length of step h. The step length 4 should be kept small enough for 

(a) the iteration [(3.14) or (3.18)] to converge sufficiently rapidly — more 
explicitly, to settle to the required accuracy after one or two cycles — and for 

(b) the first term neglected in the formula being used [(3.6), (3.11) or (3.15)] 
to have a negligible effect to the accuracy required. 


In §§ 4.1, 4.3 a significant factor in predicting convergence and estimating the 
error is found to be the quantity (the “‘step index’’) 


S=kh, where n= | 541. 
oy 


For moderate accuracy S should be of the order 0-05 to 0-1, the smaller value being 
preferable for the starting calculations. In the example of § 3.2, III, the step was 
chosen so that S=0-1 and consequently rather too many iterations were needed. 
If & varies considerably, it is advisable to adjust the length of step so that S 
remains approximately constant. We call h=const/k the “natural step length’’, 
where the constant is chosen according to the accuracy required, say in the range 
0:05 to 0:1 as mentioned above!. If the step used in the calculation is considerably 
longer than the natural step, then the differences do not decrease sufficiently 
rapidly with increasing order, the iteration converges too slowly (so that three 
cycles, or even more in certain circumstances, must be computed before the 
numbers settle) and the highest differences carried show such large fluctuations 
that confidence in their accuracy is no longer justified. On the other hand, if too 
small a step is used, the calculation runs extremely smoothly without any difficulty 
but, on account of the large number of steps required to cover the same range, 
more work is, in fact, involved. 


III. Change of step length”. Doubling the step (h=2h) merely requires the 
values y,,¥,_9,¥,—4,--- to be tabulated afresh and a new difference table of the cor- 
responding values of hf to be constructed. 

Halving the step, on the other hand, is more laborious and requires a new 
starting calculation. If the calculation has proceeded up to the point +,, so that 
t,, Vi, V2f,, V3}, are known, then interpolation by formula (2.1) of Ch. I gives 
the intermediate values 


hf,34= h (1,- _ vi — a Vi — = M1), 


- i ‘ (3.19) 
Rigg = h (+ 2 Vi,+ “7 V2ft,+ 16 V1,). 


1 CoLLatTz, L.: Natiirliche Schrittweite ... Z. Angew. Math. Mech. 22, 216—225 
(1942). 

2 Formulae for an arbitrary change in step length and for calculation with 
arbitrary non-equidistant abscissae (also for differential equations of higher order) 
are given by P. W. ZETTLER-SEIDEL: Improved Adams method of numerical 
integration of differential equations. Lecture at Internat. Math. Congr., Cambridge 


(U.S.A.), 1950. 
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Then the values hf; G=r—1,7—-# 1 v,7+, or j=0,1,2,3, if a new numbering 
is adopted) which correspond to the points at the smaller interval hs 3h, together 
with their differences, serve as starting data for the refining iteration of (3.5). 

IV. Simplification of the iterative procedure in the interpolation 
methods. The computation involved in the iterations (3.14) and (3.18) 
is simplified if only the changes in y, ,, through each cycle of the iteration 
are calculated}. These can be determined quite simply as follows. 
Consider, for example, the car (3.14); we have 


yet — yi, = = % Be (Ve li Ve feos raul 


Now since the changes 


6= ef), —vefa” (3.20) 


are independent of 0, they can be taken outside of the summation; 
hence, using the result (2.13) of Ch. I, we obtain 


yi = yl], +46, 0. (3.24) 


For the central-difference method the iteration (3.18) may be replaced 
by a similarly modified iteration: 


fot) — ylol 4 24 8%, (3.22) 


ho* =hV? fF, — ha. (3.23) 


V. Development of unevenness? with the central-difference 
method. Formula (3.16) provides a direct relation between a value 
y,-, and the next but one value y,,,, but between consecutive values 
of y there exists only an indirect link through the differential equation. 
In the course of a calculation over a large number of steps this can cause 
(in consequence of irregularities in empirically defined functions, for 
example) the two approximate solutions represented by the interlaced 
sequences ,_4, V,2, V>,--- @MG 4,25, Y,_15¥).), --. Seperate ae 
diverge slightly from one another. Thus an unevenness develops in 
the y values and since it also affects the / values through the differential 
equation, it is accentuated in the differences of f — in fact, the building 
up of these irregularities is first noticed as fluctuations in the values of 
V?f. When these irregularities reach significant proportions, they can 
be removed by a smoothing process, coupled, possibly, with a new 
starting iteration, after which the calculation is continued as before. 


where 


1 STOHLER, K.: Eine Vereinfachung bei der numerischen Integration gewéhn- 
licher Differentialgleichungen. Z. Angew. Math. Mech. 23, 120—122 (1943). 

* Compare with the theory in § 4.7. 

°Cf., for example, L. Cottatz and R. ZuRMUHL: Beitrage zu den Interpola- 
tionsverfahren der numerischen Integration von Differentialgleichungen erster und 
zweiter Ordnung. Z. Angew. Math. Mech. 22, 42—55 (1942). They give another 
smoothing procedure which is more systematic. 
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The smoothing can often be accomplished very simply as follows. 
We make small corrections + ¢ in the values of h V3}, say, so that the 
values hV%/,_;+(—4)ie, ie. AV®},,—e, hV3f,_,+e, hV3},_1—e, 
hV%},+e, run smoothly. For consistency we must make further correc- 
tions +36, +4¢, +4e in the second, first, and zero-th differences; thus 
we replace 


ne ! (3.24) 


AV" t,_; by AV*f,;+(—1) 


Finally we have to modify the y values so as to obtain the required 
corrections + $e in the f values. This can be done by varying a y 
value, say y,, by a small amount 6 and noting what change C this 


produces in /,; then the correction to be added to y,_; is (—1)/—-- 
(cf. the example in § 3.5). 


3.5. Examples 


I. Extrapolation method. If the magnetic characteristic of a coil wound on 
an iron core is assumed to be of cubic form, the sudden application of a periodic 
voltage 

e=esinwt 


across the coil gives rise to the initial-value problem! 
é dy ; 0 
aS clr a where i1=ay-+ by’, 


with y(0) =0 (notation: voltage e, current i, resistance R, magnetic flux y). 

With reduced variables x, y defined by 

éegy=aRy, x=akRti 
the initial-value problem becomes 
y=—y—2y? 4+ sin 2+; y (0) =0 
for the cases with be? = 2a R?, 2aR=w. 

This problem will be treated by the Adams extrapolation method. We obtain 
the necessary starting values from a power series solution found by the method of 
undetermined coefficients. This solution is 

1 1 1 ile 733 1903 

So eS 7 a 7 a 7 SS Ce ——— eee 

ad 3 ae 4 a 20 360 2520 6720 

in which sufficient terms have been given to calculate y(x) at y= +01, 40-2 

to six decimals. These starting values, and also the corresponding values of h/ 

with the differences required to proceed with the main calculation, are shown in 

Table II/21. Further values of y, ,, are calculated from (3.6) truneated after the 
term in Vf,. 


1 See, for example, K. KiprmMU.ier: Einfiihrung in die theoretische Elektro- 
technik, 4th ed., p. 401. Berlin-Géttingen-Heidelberg 1952. 
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Table 11/21. A non-linear problem treated by the Adams extrapolation method 


hv*f | hv 


FE 0:042253 | 0:00015 |—0-38942 
—0-1 | 0:010308 | 0:00000 |—0-19867 22284 
0 0 0 0) 20898 | — 1386 


0:018903 |18903 | —1995 | —609 
0:035237 | 16334 | —2569 | —574 | +35 


8) 
0:1 | 0:009643 | 0-00000 0:19867 
0-2 | 0:036951 | 0:00010 0°38942 


0°3 | 0:079082 | 0:00099 0°564 64 


0:048457 |13220 | —3114 | —545 | +29 
0:4 | 0:132657 | 0:00467 0°717 36 0:058003 | 9546| —3674 | —560| —15 
0°5 | 0-193 687 | 0°01453 0°841 47 0:063325 | 5322] —4224 | —550 +10 
0°6 | 0°257710 | 0:03423 0:93204 | 0:064010 


II. Interpolation method. We consider again the problem (1.21) 


and use it now to illustrate the central-difference method. Sufficient 
starting values for this method have already (§3.2) been calculated 
for h=0-1 by the Taylor series method. Thus y_,, 9, 7, are known 
and the corresponding function values /_,,/),/,, and their differences 
Vi, Vi,,V?f, can be calculated; this completes the first three rows of 
Table II/22 and we can now start the main calculation. 


The iteration (3.18) for the first step of the main calculation is 


yet = yy, +h(2A +407 f2); (3.25) 


to start it we must first estimate the new second difference [?/,. If 
we have nothing to go on, the previous value V’?/, may be taken as a 
first approximation; but in the present case it is better to make use of 
the third difference V3/,, which can be estimated quite easily from the 
derivatives y!¥(0) =—15, yY (0) =105 already calculated for the start- 
ing values. Since f=y’, we have h V3/,=h*y'’ (0) +---, so that we may 
expect that hV%/, ~(0-1)4 x y!¥(0) = — 00-0015; the next difference is of 
opposite sign [being approximately proportional to y‘(0), which is 
positive], so |/V%/| will begin to decrease as the calculation progresses. 


If we try hV*/, + — 0-001, our first estimated second difference (a 
separate column is provided in the table for these estimates) is 


hV? #2) = 0-003 — 0-001 = 0-002, 
and from (3.25) the first iterate is 
yp! = 4 + 2x 0-091 28709 + 10-002 = 1-183 2408; 


the row is completed by forming the corresponding A fj), AV /Y), hV2 72). 
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Another auxiliary column is provided for recording the differences 
of the successive iterates for hV?f as defined in (3.23). In the present 
case hV?/, has changed by 


h d* = 0-001 944.44 — 0-002 = — 0-000055 56; 


from (3.22) a third of this difference, ie. —0-0000185, added to yj" 
yields the new value y??)= 1-183 2223. 


Now we have only to work out the corresponding function values 
{2} — the new differences need not be worked out since the change in 
the second difference required to form /46* is the same as the change 
in f°) itself [as in (3.20)] —, then yf?! can be calculated from (3.22). 
On forming /'$!, we find that the change #6* is now only — 0-00000011, 
so that one third of it is smaller in magnitude than 0-5 x 107’ and no 
longer affects the y values; y{*! is therefore taken as the final value 
y= yl) and the corresponding row of differences filled in. Further 
steps can now be dealt with in a similar manner. 

At first the estimation of the new values of kV?f occasions a little difficulty, 
but after a number of steps a good idea of the run of the third differences can be 
formed and the calculation then proceeds quite happily; progress is extremely 
rapid and in fact the steps from +=1 to ¥=2 (with the exception of the point 
x = 1:3) are each accomplished in one row of computation. Gradually, however, 
the irregularities described in § 3.4 creep in, showing themselves in the third 
differences, which are alternately too large and too small; with the last decimal as 
unit the third differences for the points ¥=1-7 to +=2-0 run (with a factor h) 


ae 123, ay 77s a 90, aa 52. 
We try altering them alternately by +6, say —e, 6, —¢,¢, and find that 
€=—13 x 10-7? gives the considerably smoother sequence 

ATO SCR 77: eee 


The remaining differences at x = 2:0 are now corrected correspondingly in accord- 
ance with (3.24); for example, the first difference AV is altered by be ~ — 0-000000 3 
to — 0:0009188. 

To find the corrections to the y values which will give the correct changes 
+ €/8 in the hf values, we alter y at x = 1-8 by 6 = 0-000010, say, and note 
that the new y value 2-144849 produces a change €=0-0000018 in hf. To alter 
hf by e/8 instead of ¢, we must therefore change the values y, _j at a=2-0—j7h 


r) 
by 0’= Toh = s 0:000001. When these changes are made at *= 1:9 and *=2:0 


the calculation proceeds smoothly again until the irregularities begin to creep in 
once more, 

For comparison, the solution obtained here is tabulated in Table II/3 alongside 
the results obtained by other methods. Of particular interest is the comparison 
with the Runge-Kutta method with step interval 4 = 0:2, which, as is mentioned 
in §1.5, corresponds roughly to the central-difference method with A= 0-1 in that 
it involves approximately the same amount of computation. In this example 
the central-difference method shows up to advantage but one should bear in mind 
the warning given on page 1 of the danger of making hasty general assessments of 
methods. 
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3.6. Differential equations in the complex plane 


Let a function w=w(z) of a complex variable z be defined by the 
differential equation 
w’ = F(z, w) 
and the initial condition 
W (Zp) = Wp. 


Here F will be assumed to be an analytic function of z and w. We wish 
to calculate w(z) numerically over some desired region of the z plane. 
There are various ways open to us. For instance, all quantities 
involved can be split into real and imaginary parts 


Sweety, SOS, F=U+IV 


and the integration performed parallel to the real or imaginary axis; 
thus, integrating parallel to the real axis, we have 

Ou ov 

UU =y, (3.26) 
a pair of simultaneous first-order equations for the functions u(x, Vp») 
and v(x, Yo), which can be treated by the methods of §2 and § 3. 


Another way is to introduce a lattice of points in the z plane defined 
by z=2z,+jh+1hkl, where 7,k=0, +1, +2,... and h,/ are the mesh 
widths, and derive formulae which use the values of w at a group of 
mesh points to give approximate values of w at neighbouring mesh 
points. 

H. E. Satzer! gives such formulae for differential equations of the first and 
second order. He uses a square mesh (A =/) and obtains, for example, approxima- 
tions for the values at the points Q = (0, 2), (1, 2), (2, 1) and (2, 0) from the values 
at the four points P(j, k) = (0, 0), (0, 1), (1,0) and (14, 1). 

Firstly some ordinary extrapolation formulae of such form which are exact 
for polynomials of the third (and less) degree are derived: 


Fe =(2-)F+ (244) R214 (-3-1) Aas, 
Faux = 214 (—3 4+) K+ (24+) K+ (2-41) yj, 


Fagi= — 214 (2-1) A+ (-3-d) KF (24-41) Ray, 
E; (2+ 1) Fy4-21F,4+ (2-4) B+ (-3 +1) Rai. 


I 


For compactness, argument values are here denoted by subscripts. 


Further, formulae for approximating 


Plz) =C4+fF(o)de 
0 


1 Savzer, H. E.: Formulas for numerical integration of first and second order 
differential equations in the complex plane. J. Math. Phys. 29, 207-216 (1950). 
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are given: 
UDJh =(9+ 51) H+ (9-5) K+ 3+) R+(3—-) K+, (3.28) 


24Gb =(5+9) H+ (1+3)R+ (—5+9) B+ (—-14 3) Rit, 
24.0, ,/h = (8+ 81) + (44.41) A+ (44 41) B+ (8 + 81) Ri +C. 
These likewise are exact for polynomials of up to the third degree. 


If we know approximate values of w, and hence of F, at the four points P 
(to start the calculation we must first calculate w at three points by some starting 
technique, say a series solution), we can obtain approximations to F at the points 
Q from the extrapolation formulae (3.27). Then, using the approximation to the 
differential equation obtained from (3.28), we calculate w at the points Q and, if 
necessary, improve these values of w by repeating the process with revised values 
Gi) jae 


3.7. Implicit differential equations of the first order 


Occasionally it happens that when a differential equation is presented 
in the form 
Fw Vv) —=O (3.29) 


it cannot be solved for y’ in closed form. There are various ways of 
dealing with this situation: 


4. In general, (3.29) can be transformed as follows into a pair of 
simultaneous explicit differential equations of the first order?, which can 
then be integrated numerically by one of the methods of § 1, § 2 or § 3. 
We assume that the required solution is such that y’’(x) == 0; then to 
t=y’(x) there is an inverse function x= x(?). Differentiation of (3.29) 
with respect to # yields 


1 In addition to the ‘four-point formulae’ quoted above SALZER (see previous 
footnote) gives formulae for 3 to 9 points and also formulae for repeated integration 
which can be used for second-order differential equations; thus for 


s¢ 
Wz) = Az+ B+ ff F(s)dsdt 

00 
he obtains the formulae 
120% /k2 =0+Az,4 B, 
120¥,/h2 == (33 + 131) Fy + (12— 121) R+ (842) F4(7—- 38) Ri; t+At+B, 
120Wj/h? = (— 33+ 131) Rt+ (—-84+ 21) K+ (—12—121) B+ 

+(—7 —3!) Beat aes 2, 

1207, 4,/h? = 561+ (44 201) A+ (—4+ 201) B+ 241 Ry;+ Aaa t B. 


2 KamKE, E.: Differentialgleichungen reeller Funktionen, 2nd ed. (436 pp.), 
p- 112. Leipzig 1944. 
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so that, if we assume further that F,+ F,t-+0, we obtain the system 


ax Ff, Bl 

iy epee eee) ioe 
Dole O ee SES 1 Hf yp oul 
dt dx dt F,+Kit (x, 9,2). 


The initial conditions are x =x», y = yg at ¢= yg, where yq is determined 
from F (x9, Yo, ¥o) =0. Solution of a set of two first-order equations by 
a finite-difference method normally requires two difference tables, but 
since the differences of tf can be expressed in terms of the differences 
of f [e.g. V° (tf) =t,V°f, + ehV? 4 f,_1,, where his the step length], the 
computation for the equations (3.30) can be arranged! so as to use only 
the difference table of }. 


2. Differentiation of (3.29) with respect to x yields the second-order 


equation , 
” tf, 
ba as a ee , (3.34) 
7 
provided we assume that F.+-0. This is of explicit form and can be 
treated by the usual methods for second-order differential equations. 
3. If we define F( ’ 
, , %, y, ¥y 
499) =y7 - ————— , 2 
Sr — ry. 9) (3.32) 
we can set up the iterative process 


x 


Yy(x) = Vo t+ fys(4)d%;  ¥o41 (4) = (4, ¥y(*), 9 (4)) (v= 0,1,2,...). (3.33) 


*9 


WEISSINGER! gives a convergence proof and error estimates for this method. 


§ 4. Theory of the finite-difference methods 


We start here by investigating the convergence of the iterations required in 
the interpolation methods of the preceding section, then describe how error esti- 
mates can be derived for all finite-difference methods. Formula (4.43) deserves 
particular mention as being a fundamental error formula for the central-difference 
method. § 4.7 deals with the danger of instability in finite-difference methods. 


4.1. Convergence of the iterations in the main calculation 


Here, and in the rest of § 4, it will be assumed that the function 
}(x, y) appearing in the differential equation (1.10) satisfies a Lipschitz 
condition (4.12) with constant K. In practice K is usually taken to be 
the largest absolute value of the derivative 0//éy within the domain 
under consideration, i.e. 


7) 
K=Rmax Where k= |- i : (4.4) 
| Oy 
1 WEISSINGER, J.: Numerische Integration impliziter Differentialgleichungen. 
Z. Angew. Math. Mech. 33, 63—65 (1953). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 7 
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With this assumption, quite a simple analysis suffices to examine 
the convergence of the iterations required in the interpolation methods. 
First of all we investigate the iterations (3.14) and (3.48) which occur 
in the main calculation. 

For this we consider the equations in their Lagrangian form, in which 
the differences are expressed in terms of the function values, as in (3.12) 
for the interpolation formula (3.11). Using (3.13) we can write the itera- 
tion equations for the Adams interpolation method (3.14) in the form 


p 
ee =e oe h ay Ba ao Lae ee (o =0Q, AG Qyiss -) . (4.2) 
e= 


If the corresponding expression for y!?), is subtracted from this equation, 
we see that the change 


60) — ylett — ylel, 
)]. 


oo” — hB, U(%,41, we) aa I(x, X44 ea 
The Lipschitz condition (4.12) provides limits for the right-hand side: 


6) = hKB Pesca ; 
| | : . (4.4) 
[d]] = (AK B,) Oe (oe? 8 
We now suppose that h is so small that 


Ripe 
<< ae (4.5) 


then the geometric series |6™!| >’ (AA B,)°, which majorizes the series 
o=0 


is given by (4.3) 


and it follows that 


ie.@) 
> 6"), has a ratio hB, K which is less than one and therefore converges. 
o=0 


Consequently the series 

lim (7, = iG, + 6) + 6M + 68] + .. 

o—> co 
converges (absolutely, in fact) to a value v,,,, which provides a solution 
of (3.11). Thus the inequality (4.5) represents a sufficient condition for 
the convergence of the iteration. For the values of p normally used 


we have ie 


Kh< - re267 «= f0r’ jp ae (4.6) 
= 720 = 
Se 2:87 for p=4. 


For the central-difference method (3.15) the rearranged form of the 
iteration formula (3.18) is 


= a+ hat 4t + fy). (4.7) 
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The same considerations as for the Adams interpolation method now 
yield 


o h a a= 
i) = Geet) —1 Oa) 


for the change 6!) of (4.3) and hence a sufficient condition for the 
convergence of the iteration in the central-difference method is 


An 3. ; (4.8) 


4.2. Convergence of the starting iteration 


For investigating the convergence of the starting iteration (3.5) we 
make use of a theorem in matrix theory. This is concerned with a 
sequence of sets of quantities 


mga (p= 0;4125..), 


which are bounded successively thus 


?p 
| «P| = iI Ayo| [ae-™ | (vy =1,2,...5 @ =1,2,...,0). 


The theorem states!: For the convergence of the # series 


co 


See) | (o= 1,2, ... 90) 


v=0 
it is sufficient that the absolute values of all the characteristic roots x 
of the matrix 

[Ars] | Aral --- | Aro 
7 (| 5 AQeeA aera coe On Geet (4.9) 
lApi] [Apel --- [Apo 
be less than unity, ie. |x,|<1 for o=1,..., p. 
The characteristic roots x, of a matrix B with elements 0,, are 

defined as the roots x of the ‘‘characteristic equation” of B: 


by, — % Dis eoe by» 
bey bop —% «++ Day =. (4.10) 
| bys Dye eee by,— x| 


We now turn to the starting iteration. The equation (3.5) which 
describes it becomes 


p 
Ang tot ear (Om, 2, ...,P; vee 2)...) (4.11) 
a1 - 


alia = Voth 


1 See, for example, L. Cortatz: Eigenwertaufgaben, p. 311. Leipzig 1949. 
7* 
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when written in terms of the function values. The values of the a,, 
for p =2, i.e. using only the formulae of (3.5) within the dotted frame, 
are given in Table II/23 and for p=3, i.e. using the complete set of 
formulae (3.5), in Table IT/24. 


Table II/23. The og forp=2 Table I1/24. The Qo¢ for p=3 


From (4.41) we find that the changes 


[>] — q[v+1] _ ,,[»] 
6; aoe Vo 


are given by 
oy = ID apalHl Dei age ) i 
(0 42) 3, 1, 25 es) 
using the Lipschitz condition (1.12) we obtain the inequalities 
[82] KAD ape] A. (449) 


The convergence of the series 
i) al 0 1 [2 
is assured by the above-mentioned matrix theorem provided that the 
absolute values of all characteristic roots yz of the matrix 4 with elements 
Kh\a,,| are less than unity, i.e. provided that the absolute values of 
all characteristic numbers u* of the matrix 


|x| - <2) eaeaee| 
A*=|. 


[apr] «++ [apo 
are less than (Kh)71, 


Given the matrix A*, which we are, this condition provides an upper 
bound for Kh. Thus for p=2 


re la 
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and the y* are the roots of 


eo es 

12 12 1 { 
4. tee namely ee ea Ld 
3 3 M 

Consequently convergence is ensured by choosing / such that 


ie. Kh<4-44. (4.14) 


0-873 
0-427. 


4 
h 2 ei 
= 0°873 ’ 


For p =3 the corresponding equation is 
mo—e 5 A 
32 Se 0 10) 
aes 2 Get! 


where t=24,*, whose largest root is u* 1-24, and the iteration 
certainly converges if 


Kh<—, ie. Kh<08.. (4.15) 


The limits (4.14), (4.15) on AKA for the starting iteration are more 
restrictive than the limits (4.5), (4.8) for the iterations in the main 
calculation. This fact accords with the particular sensitivity of the 


starting iteration. 
4.3. Recursive error estimates 


In this and the following section we describe! how error estimates 
for the finite-difference methods can be derived; we may note that 


1 For literature on error estimation see the following list: Misrs, R.v.: Zur 
numerischen Integration von Differentialgleichungen. Z. Angew. Math. Mech. 10, 
81—92 (1930). — ScHuLz, G.: Interpolationsverfahren zur numerischen Integra- 
tion gew6hnlicher Differentialgleichungen. Z. Angew. Math. Mech. 12, 44—59 
(1932). — Fehlerabschatzung fiir das Stormersche Integrationsverfahren. Z. Angew. 
Math. Mech. 14, 224—234 (1934). — CoxLatz, L.: Natiirliche Schrittweite bei 
numerischer Integration von Differentialgleichungssystemen. Z. Angew. Math. 
Mech. 22, 216—225 (1942). — Differenzenschemaverfahren zur numerischen Inte- 
gration von gewohnlichen Differentialgleichungen m-ter Ordnung. Z. Angew. Math. 
Mech. 29, 199—209 (1949). — HameEL, G.: Zur Fehlerabschatzung bei gewohn- 
lichen Differentialgleichungen erster Ordnung. Z. Angew. Math. Mech. 29, 337-341 
(1949). — WEISSINGER, J.: Eine verscharfte Fehlerabschatzung zum Extrapola- 
tionsverfahren von ADAms. Z. Angew. Math. Mech. 30, 356—363 (1950). — Eine 
Fehlerabschatzung fiir die Verfahren von ADAMS und STORMER. Z. Angew. Math. 
Mech. 32, 62—67 (1952). — Tott-mien, W.: Bemerkung zur Fehlerabschatzung 
beim Adamsschen Interpolationsverfahren. Z. Angew. Math. Mech. 33, 151 -155 
(1953). — Unimann, W.: Fehlerabschatzungen bei Anfangswertaufgaben gew6éhn- 
licher Differentialgleichungssysteme 1. Ordnung. Z. Angew. Math. Mech. 37, 
88—99 (1957). — Fehlerabschatzungen bei Anfangswertaufgaben mit ciner ge- 
wohnlichen Differentialgleichung héherer Ordnung. Z. Angew. Math. Mech. 37, 
99—111 (1957). — VrEeToris, L.: Der Richtungsfehler einer durch das Adamssche 
Interpolationsverfahren gewonnenen Naherungslosung einer Gleichung y’ = /(%,¥). 
Ost. Akad. Wiss., Math.-naturw. K1., S.-Ber. Ila 162, 157--167, 293-299 (1953). 
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the general remarks on error estimation made in §1.3 apply here. 
The first rigorous error bounds were obtained by R. v. MisEs?. 


To simplify matters we make the following assumptions: 


4. The number of decimals carried in the calculation is sufficient for 
rounding errors to be neglected. 


2. The iterations (3.5), (3.14), (3.18) are always repeated until the 
numbers settle to the number of decimals carried so that it can be assumed 
that the values y, ave exact solutions of the corresponding equations without 
the bracketed superscripts. 


As will appear later, the following will be needed in the derivation 
of the error estimates: 


1. A Lipschitz constant K [as in (4.1)]. 


1 RIcHARD EDLER VON MISES was one of the most eminent of applied mathe- 
maticians. The modern broad conception of applied mathematics is due to him, 
and his exceedingly numerous and diverse contributions to this comprehensive 
applied mathematics have had no little influence on its present-day importance; he 
published fundamental and pioneering work in almost every constituent subject: 
in practical analysis, geometry, probability theory, mathematical statistics, and 
in various branches of mechanics, from strength of materials and theory of machines 
to the mechanics of plastic media and hydro- and aerodynamics. Over and above 
these specific accomplishments he strove for philosophical understanding; he set out 
his unified “‘positivistic’’ view of the world, which was influenced by ERNstT Macu, 
in a book “‘KLEINES LEHRBUCH DER PosiTIvMus’’, which embraced even religion, 
art and poetry. He had a great love of German literature and was particularly 
interested in the works of the Austrian poet RAINER Marra RILKE; vV. MISES was 
one of the greatest connoisseurs of RILKE and possessed one of the most notable 
collections of his works. 

v. MIsEs was born in Lemberg, Austria, on the 19th April 1883. He obtained 
his doctorate at the Technische Hochschule in Vienna in 1908 and in the same 
year qualified as lecturer in Briinn. In 1909 at the age of 26 he took up a post 
as extraordinary professor at Strassburg. After the first world war, in which he 
saw flying service and also designed a large aeroplane of some 600 h.p. bearing 
his name, he went as professor first (1919) to Dresden and then (1920) to the 
University of Berlin, where he set up and directed the Institut fiir Angewandte 
Mathematik, which was to become famous later. Also in 1920 he founded the journal 
ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, the forerunner of 
many similar journals founded later; he was editor until 1934. During the years 
1933— 1939 he worked at the University of Istanbul, where, at the request of the 
Turkish government, he founded an institute for pure and applied mathematics. 
In 1939 he accepted an invitation to Harvard University, Cambridge, Mass., where 
he remained, becoming Gorpon McKay Professor of \erodynamics and Applied 
Mathematics in 1943. 

To the last years of his life he was exceedingly productive in the scientific 
field and retained his great versatility and nimbleness of mind. Highly honoured 
with the honorary degrees of numerous colleges, loved and respected by a vast 
number of friends and pupils from all parts of the world (the author of this book 
was one of his pupils), he died in Boston on the 14th July 1953, leaving a widow, 
HILDA GEIRINGER, his colleague for many decades. 
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2. Error limits Y, for the starting values y,. If, for example, the 
necessary starting values are calculated by method II of § 3.2 (Taylor 
series method), the error can usually be estimated very easily; the 
maximum rounding error, i.e. $X10~% for a d decimal number, will 
often provide a suitable upper bound. If the iteration method (method 
III of § 3.2) is used to obtain the starting values, the error can be esti- 
mated by a special method! (cf. § 4.5). 

3. An upper bound for the absolute value of a certain derivative 
f= SiN] . When /(x, y) has a simple analytic form, the estima- 

x 
tion of / from the explicit expression obtained by differentiating / is 
usually quite straightforward. Mostly, however, this method is very 
complicated and in fact sometimes may not be possible at all (for 
example, when empirical laws are involved). In such cases we must 
be content with an approximate value for |/"|,,.. inferred from the 
difference table, using the fact that 


f (x4, Y(%)) & — V8 fyi 


if the g-th differences run smoothly, we can get a fair idea of the maxi- 
mum absolute value of /'”. Of course, a rigorous error estimate cannot 
be obtained by this method. 

We investigate first the Adams interpolation method, which is based 
on the formula (3.11). In Lagrangian form this formula reads [as in 


(3.12)] ae 
Veit =¥% th Li tpelrss—o° (4.16) 
ae 


A similar relation, but with a remainder term Saan holds for the exact 
solution: 


V (X44) = ¥(% ) thd ahah (x Xy+1—-9> Y(%p+1-)) - Spe (4.17) 


For this remainder term, or “‘truncation error’, there exists the estimate 
(2.41) of Ch. I: 
| So44| = C*, where C* = hP**| BF, | [/?*? |max- (4.18) 


For the error 
é, SS y (x,) 


subtraction of (4.17) from (4.16) yields the relation 
b 
A Oy iri ter Q? y (x Xy41- re) ))}— Shia. 
e=0 


1 See also p. 57—58 of G. SCHULZ: Interpolationsverfahren .... Z. Angew. Math. 
Mech. 12, 44—59 (1932), which has already been mentioned. 
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The differences of the / values which occur in the summation can be 
estimated! by means of the Lipschitz condition (1.12): 


? 
|ér4] Sle] +4K Zl ael |€41-9| + C*. (4.19) 

om 
If the equality sign is written in place of “<<”, an equation results 
which determines recursively a sequence Y, of upper limits for the errors 
€, once upper limits Y, for the first p errors ¢, (s=0,1,...,P—1) are 
known. In principle, therefore, an error estimate can be obtained from 

the equations 


b 
(1—AKB,) V41= (1 +4Klapi|) ¥, + 4K D lape| Yr» + C* 
e=2 


(ry =p—1,9,p +1,...)}, 
where #, has been substituted for apo in accordance with (3.13). 


Here h is to be chosen so small that KhB,<1. This is the same 
condition as that which ensures a convergent iteration in the main 
calculation, namely (4.5). 


(4.20) 


1 WEISSINGER, J.: Z. Angew. Math. Mech. 30, 356—363 (1950); 32, 62—67 
(1952), has succeeded in refining this estimate somewhat by performing additional 
manipulations before taking absolute values. He writes down the equation for 


y¥,y—1,...,7—1l, where /=p, and adds, obtaining (with the different truncation 
errors distinguished by the notation s} p11) 
p+ I 
741 — erp th 2, ba {fy+1—0 —f(%, 24-0: ¥ (eae) — 2 So.p+1) 
o=0 a=0 
where 
oO 
Dias for OSoSp 
t=0 
p 
bg = Lays 1 for Prsie ST 
t=0 
p 
» * x for Sospl. 
t=o— 


Taking absolute values now yields 
p+ 
| &rta| S| ey—a| + 4K ¥ | bol] e410] + (2+ 1) C*. 
o=0 


This is the equation which corresponds to (4.19) and the further considerations 
leading to an independent error estimate which are applied to (4.19) in § 4.4 apply 
here quite analogously: z is to be determined now from 


i+p 
et? g-1_ KAD [b,| 2 tP-o = oO 
o=0 


instead of from (4.28). 
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Precisely similar considerations applied to the Adams extrapolation 
method (3.6) lead to the equation 


p 
Y= thKD lapel Yo tC (=P p +4), (4.24) 
where i 


C = hPt* BS | FP | ax: (4.22) 


applied to the central-difference method they give 
(1—$KA)Y,,,=4KhY,+(1+4Kh) ¥,,+0% (7 =1,2,...), (4.23) 


where 
C** — FP | f) | max: (4.24) 


Here again the condition on A, namely Kh<}, is identical with the 
convergence condition (4.8) for the iteration in the main calculation. 


4.4, Independent error estimates 


Practical application of these recursive estimates is laborious so we 
now establish an upper bound for Y, which does not entail the calcula- 
tion of the previous Y,. We forfeit something thereby, as might be 
expected, for the error limits so obtained generally prove to be less 
precise than those calculated recursively. 

Again we deal with the Adams interpolation method first. The error 
limits Y, for this method satisfy the linear inhomogeneous difference 
equation (4.20) with constant positive coefficients. The solution of this 
equation which is determined by the starting values Y, Y,,..., Y,_1 is 
majorized by any particular solution W, such that 


Vee Y= 0 for oO = 0,41,...,2 —1, (4.25) 


for these inequalities remain valid for all positive @ on account of the 
positive coefficients in (4.20). 

Now the general solution of a linear inhomogeneous difference equa- 
tion with constant coefficients can be given in closed form. In precisely 
the same way as with the corresponding type of differential equation 
the solution can be written as the sum of a particular solution W") of 
the inhomogeneous equation and the general solution W™) of the homo- 
geneous equation. In the present case W") can be taken as a constant 
W* and by substitution in (4.20) we find that 
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The well-known method for solving the homogeneous equation is to 
assume a solution of the form 
W=7; (4.27) 
from (4.20) we must have 
p 
(1— KhB,)2t?= (44 Khlopi|)2 + Kh) |ap,| 274? 2, 
o=2 


which yields the “characteristic equation” 


p 
2 ee Nn ene (4.28) 
oe=0 


for z. 

This equation always has a positive root z greater than unitv, for 
the left-hand side is zero, and therefore smaller than the positive right- 
hand side, when z=1, and, since the coefficient A hB, of the z? on 
the right-hand side is less than unity [assumption (4.5) , the left-hand 
side must be greater than the right-hand side for sufficiently large 
values of z. In the following we take z to be the smallest of the roots 
of (4.28) which are greater than unity. We can then determine a constant 
A so that the 

W=Wt+Az (4.29) 


satisfy the inequalities (4.25) for 9 =0,1,...,—41 and hence also for 
all positive 9. If all |¢,| with e=0,1,...,—4 are less than e, we can 
put A =«— W* (W* is negative), thus obtaining the error limit 


| e,| Sez’ — W*(z" — 4); (4.30) 


with the values substituted from (4.18), (4.26) this becomes 
|e,| Sex’ +yphett |p M sel — 1) (= 4,2,...), (4.34) 


where the yf are defined by 
|Bp 
vp = lPesal (4.32) 
x lofol 
=0 
and are given numerically for the first few values of # by 


1 


v= 


Tie a 


ey ee 
V2 aa “28° & 0-0357, 
(4.33) 
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This method of finding a solution W, of the difference equation which 
majorizes the error limits Y, can also be applied to the Adams extra- 
polation formula. The appropriate difference equation (4.21) now has 
the particular solution 


— (4.34) 
Kh YX |e o| 
o=0 
and for the solution (4.27) of the corresponding homogeneous equation 


we determine z as the smallest positive root greater than unity of the 
equation 


~ 
gett — = Kh > |0,,| 2°. (4.35) 
e=0 
If « has the same significance as for the interpolation method above, 
we obtain here the limits 
| ¢,| S ez” — W(2" —1). (4.36) 
With the values (4.22), (4.34) this reads 


| e,| 2 ez! + y,hPtt eel eg 1) (7 =1,2,...), (4.37) 
where 
Ye = ee (4.38) 
am Xp o| 


(a= 


Numerical values for the first few y, are 


wl 5 Moan) 
w= = © 0-2033, 


Ye= 4, © 0-1023, (4.39) 
be 251 ae 


Finally we derive in a similar fashion an estimate for the error in 
the central-difference method. A particular solution of the pertinent dif- 
ference equation (4.23) is 

Cre 
7 My ca. : 
aan” (4.40) 
and for the solution of the corresponding homogeneous difference equa- 
tion we again use the smallest positive root z greater than unity of its 
characteristic equation, which here reads 


3 (2241) = Kh(22 + 42 +1). (4.44) 
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For the determination of A in the particular solution 
W, = W** + A ze 
we ought strictly to distinguish between the cases in which the limits 
| e,|<Se are known for 9 =O, 1, 2 and 9g =0, +1, respectively, but since 


the second case can be reduced to the first by re-numbering the @ values 
(displacing them by 4), we need only write the error estimate in the one 


ee | ¢,| S ez’ — W**(2" — 4) (4.42) 


70 
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kh 
Fig. 11/4. Curves of the quantity zs, which determines the growth of the error limits, plotted against 
hK for various methods and orders of approximation. — — — Apams’ extrapolation method (3.6), 


eeeeees NystROm’s extrapolation method (3.10), Apams’ interpolation method (3.11), 
-— ee Central-difference method (3.16) 


corresponding to the first case; substituting from (4.24) and (4.40), we 


have aa 
le|s a ear | f | max (2” — 4). (4.43) 


For large values of 7 the growth of the error limits (4.31), (4.37), 
(4.43) is determined by the power <’. Consequently the usefulness of 
the error estimates for the various methods may be compared by com- 
paring the corresponding values of : for given Ah. This is done in 
Fig. II/4, where curves of z against A are drawn for small A/i for the 
three methods which we have been considering and also for NysTROM’s 
extrapolation method; except for the central-difference method, for which 
p =2, the curves for several values of # are shown for each method?. 


1 Although not exactly, the curve for the Adams interpolation method with 
p =1 coincides to within the accuracy of Fig. II/4 with the curve for the central- 
difference method. 
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For ease of comparison the curves for #3 are printed more heavily; 
we choose =3 so that the truncation error is of the same order (h!) 
as the central-difference method for all the methods compared. We see 
that the z values are smallest, and therefore the error limits most effec- 
tive, for the central-difference method. It is unfortunate that the z 
values increase with # so that, although in general the calculation will 
be more accurate for larger p (so long as the differences do not start 
increasing or fluctuating), the error limits for large 7 become less pre- 
cise as # increases. 


4.5. Error estimates for the starting iteration (3.5) 


We describe briefly how one can estimate the error in the starting 
iteration (3.5). .For the exact solution we have 


y(%) =Vo + h(Fo Ee 3VF, = +¢V?F ae a V*F) +S), 
9 (%2) = Yo +h(2F, +4V?E) +5S2,¢ (4-44) 
y¥(%3) =y(%4) +h2R +407?R) +Ss, 


in which we have introduced the notation F =/(x,, y(x,)) [the notation 
Ss, for the remainder terms is not the same as in Ch. I (2.11)]. 


| qe 
If N,=| ; [| [ef. (4.23)], we have from Ch. I (2.10) 
| x jmax 
~ 19 
[Si] S4°|Ba'| Ny = 5 HPN, (4.45) 
and from Ch. I (2.48) 
= RS Rs nS 
IS]Sy5 Me [Sal Sao M- (4.46) 


Now we imagine the differences in (4.44) expressed in terms of the 
function values so that we can subtract it from (4.11), the corresponding 
form of (3.5); the coefficients a,, are given in Tables II/23, II/24. Using 
the Lipschitz condition to estimate the function differences which arise 
on subtraction, we find that the absolute values of the errors | e;| = 
|y;— y(%;)| satisfy the inequalities 


4 ~ 
Jeq| AK Z|agol lee] S/S] (0 = 42,3), (4.47) 


where 5, = S$, + S3- 

We can replace the right-hand sides by the upper bounds given by 
(4.45), (4.46), and we then consider the corresponding set of equations; 
these determine quantities which we will denote by Y,. In matrix form 


we have 
Yawn BY 2S; (4.48) 
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where 
Y, | 411| | @19| | 413| Si 
Y=(¥%J}, B= | @2,| | aeo| | 424| », S={S, 
Y3 | @31| | al | @3a| S3 
and 
Si] S 5) = PM, [52] SS, = M, [So] S Ss = N. 


If J denotes the unit matrix, the solution of the matrix equation 
(4.48) is given by 
Y=(1+AKB+h?K? B+...) § (4.49) 


provided that the matrix series converges. Now the condition ensuring 
the convergence of the initial iteration (§ 4.2), i.e. that the absolute 
values of all the characteristic roots of the matrix hKB shall be less 
than unity, also ensures the convergence of this matrix series}, so (4.49) 
is the solution and the limit matrix is the inverse of the original matrix 
I—hKB. Clearly this limit matrix can have only non-negative coeffi- 
cients so the system must be monotonic (see Ch. I, § 5.5) and it follows 
that the Y, are upper limits for the | ¢,|. 

These limits can be found by solving the equations (4.48) but it is 
quicker, though less precise, of course, to derive upper hmits for the 
Y, from the solution (4.49). If } is the largest element of B, then any 
element of B? is at most 302 and in general the elements of B? cannot 
exceed 3(3)%; thus the matrix series in (4.49) is majorized by the series 
I+ 3)4(36hK)°J, where J =(jgc) is the matrix with j,,=1. If 

s=0 


oa 
3bhK <1, we can sum the geometric series to obtain the error limits 


hKb 
| €,| Ss ye et (Sy +S, + S5) (o =1,2,,3). (4.50) 


4.6. Systems of differential equations 
W. RicHTER? extends the above results to the system 
Vo (*) = fy (%, M(%), ++) Yn(%)) (VA, ) 


with prescribed initial values y, (0). 
Let the /, satisfy Lipschitz conditions of the form 


n 
[fo(¥ Ws Mn) —h(% EL. MDL SK 2% vil (v= 1,...,m) 
= 


1 See, for example, L. Cotzatz: Eigenwertaufgaben mit technischen Anwen- 
dungen, p. 311. Leipzig 1949. 

? RICHTER, WILLY: Examination de l’erreur commise dans la méthode de 
M. W. E. MILNE... (43 pages). Diss. Neuchatel 1952. 
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in a certain domain D of the (¥, ¥,, ..-, ¥,) space and let 


5 4 
R= max | Mhele) |, 
v, D 180 dx* 
_hkKn 2(1+28 9) Rk : ; 
_ put q= ——— and 0 = eR . For the approximations Y,, to y, (7h) 
obtained for r= —1, +4, +2 from a starting iteration (convergent for g< 1) and 


for y > 2 from MiLNeE’s formulae (see § 3.3, IV) it is deduced that there exist error 

limits w, (|Y¥,,—%y(rh)|S@,) with the upper bounds {corresponding to (4.30)] 
wy, Sot + O(e-7— 41), 

where @ = max (w_,, @,, @,) and z is the positive root of 


A— 4q(4+29¢)2— (1 +9¢ +4 49°) 22— 8q?z—q=0. 


4.7. Instability in finite-difference methods 


It can happen that an approximate solution calculated by a finite- 
difference method is unstable? even though the differential equation is 
inherently stable. This is particularly so when the difference equation 
used is of higher order than the differential equation, for it then has 
more independent solutions than the differential equation and among 
them there may be increasing solutions (which, on account of the ever- 
present rounding errors, finally determine the behaviour of the approxi- 
mate solution) even when the differential equation possesses only 
decreasing solutions. 

The following theory, developed by RUTISHAUSER?, offers an explana- 
tion of the phenomenon. Several simplifying assumptions are made. 

We can survey the situation in a rough way by assuming that /,, 
for the differential equation (1.10) can be treated as piecewise constant. 
We then consider the calculation of the y,, say by the central-difference 
method (3.16), over an interval J of constant f,. Wet ypskaj, be another 
solution of the equation (3.16) for which the 7, are siall, i.e.anethe 
nature of perturbations from the solution y,, in fact so small that qua- 
dratic terms in the 7, are negligible in comparison with the linear terms. 
Then these perturbations 7, satisfy the linearized ‘variation equation” 


h 
Nyt. = Ny-1 er i 5 (H,—1 ae 4n, ae Ny+1) . 


1 The development of unevenness with the central-difference method which 
was mentioned in § 3.4, V [for which reference was made to L. Cotiarz and 
R. Zurmvuv: Z. Angew. Math. Mech. 22, 46 (1942)] is also due to such a condition 
of instability. For further examples of unstable behaviour see J. Topp: Solution 
of differential equations by recurrence relations. Math. Tables and Other Aids 
to Computation 4, 39—44 (1950). 

2 RutisHauser, H.: Uber die Instabilitat von Methoden zur Integration ge- 
wohnlicher Differentialgleichungen. Z. Angew. Math. Phys. 3, 65—74 (1952). — 
See also W. LinicER: Stabilitat der Differenzenschemaverfahren. Diss. ETH 


Ziirich 1956. 
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Here we have already used the assumption that /, is constant in /. 
This linear homogeneous difference equation can be solved in the usual 
way by assuming a solution of the form 7,=A’; we find that 4 must 
satisfy the quadratic equation 


(4 — 2) Ai (1 +=) =0, (4.54) 


where H =h},,, whose roots are 
- eh ci a 
Ay 8 ee ee we 


a HE. get 
We now treat similarly a perturbation of the exact solution y(x) of the 
differential equation y’=/(x, y). We select another solution y (x) +(x) 
and, on the assumption that 7(x) is small in the same sense as for ", 
above, derive the differential equation 


'(x) = fn (x) 


for n(x), which must therefore be proportional to e/”?. Such a function 
changes by a factor e” over an interval of length h. Now if i>, Ge 
component A) in the central-difference solution dies away exponentially 
and since A, we", a perturbation 4, 8TOWS at approximately the same 
rate as the same perturbation in the solution of the differential equa- 
tion. If, on the other hand, /,<0, then the differential equation is 
stable, i.e. small perturbations die away, but, in general, small per- 
turbations 7, in the solution of the difference equation increase exponen- 
tially; a component proportional to A, is always introduced by the 
inevitable rounding errors. Consequently the method will be described 
as unstable for the case /,<0. This does not necessarily mean that the 
method is unusable for this case but it is advisable to estimate the error 
which may arise through instability of the method as being roughly of 
the order e~#"/v" 40-9 at the r-th step of the integration, where q is 
the number of decimals carried. 


In the work referred to, RUTISHAUSER also shows that for the Runge- 
Kutta method and the Adams extrapolation method no instability need 
be feared provided that f is chosen sufficiently small}. 


1JIn a note RutisHausER shows that, with increasing h, instability first sets 
in much later for the interpolation method than for the extrapolation method. 
A similar result was found by A. R.MitcHeEty and J. W. Cras: Stability of 
difference relations in the solution of ordinary differential equations. Math. Tables 
and Other Aids to Computation 7, 127—129 (1953). 
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4.8. Improvement of error estimates by use of a weaker Lipschitz 
condition 


The estimates which we have derived for the errors in finite-dif- 
ference solutions of y’=/(x, y) can lead to better results if the Lipschitz 
condition (1.12) on f(x, y), which involves absolute values, is replaced 
by the weaker condition? 

f(#, 7) — £(#, 9) a ha 
Mu— Va 
This affords a more realistic and accurate discription of the actual 
situation than the condition which also specifies a lower limit for the 
quotient, particularly when a negative value can be chosen for L. 
Consider the more general system 


Vj =H, Vrs Vareves Yn) (Ff = 1,2, 8) (4.52) 


with the initial conditions y;(x9) =y;9, where the /; are given continuous 
(real) functions in a domain D of the (x, yy, yg, ---, ¥,) space which 
contains the initial point (%9, ¥y9,---, Yao). For any two points 
(4, Vis -++> Vn)» (%, V1. +-+» Yq) in D with the same x let the function 


L*(x,%; enya M> seg Va) 
Bthl Var oer In) — by l%s Yo over Yad] Gj — ¥%) (4.53) 


—— = 


20 ia 
satisfy the condition 
L*(2, Fas o0-1 Tur Dv er Ya) SE. (4.54) 


If we take two sets of functions y;(x) and y,(x) which, for 
X%pSxSx_+a, are differentiable and lie within D and insert them into 
the differential equations, we will be left with the “error functions”’ 


E(x) = 9; (x) — fy(% i> ++) Yn) | 
&;(*) = ae Yar sees Yn) 

Now suppose that y,(x)=¥,(x) for 7=1, 2,..., and with 

5i,(x) — 9j() = “7 ya0, Fla) — glx) = 644s) 


(4.55) 


define 


—— 5 Taya) g(x) 
+ 1/ Dag(x) =2(x), + | Dexa), Papen Fla). 
j=l jail 


1 See H. ELTERMANN: Fehlerabschatzung bei naherungsweiser Lésung von 
Systemen von Differentialgleichungen erster Ordnung. Math. Z. 62, 469—501 
(1955). Here we shall only sketch the basic idea of the error estimate, The assump- 
tions actually made by ELTERMANN are slightly weaker still. 


Collatz, Numerical treatment, 3rd edit., 2nd print. 8 
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According to SCHWARz’s inequality, ¢(1) = |@(x)|; we will assume that 
2(x)>0 for %y>x=x +a. From (4.55) it follows that 

&;(%) = 2; (x) — f; @ | 9 ae ¥,(%)) + f, (x, yi (x), roan MRe)) 3 
then multiplication by 4 and summation over j from 1 to » vields 


&(x) =2'(x) — L*(x)2(x), (4.56) 


where L*(x) is written for the function E*(&, Slade... egal, ww, 
.++)¥,(X)). This is a linear differential equation for s(x) with the selu- 
tion 

200) =x, Wedep | i ae at| + f &(s)exp( f L*tdt}ds. 
Finally, using (4.54) and the fact that [E()]Se(x), we arrive at the 
estimate 


%(x) S2(xq) eh) + f o(s) bl ds, (4.57) 


If y,(x) and y,(x) take the prescribed initial values. then £ (fg) =O 
and the first term on the right-hand side disappears. (The resulting 
upper limit for z(x) implies the uniqueness of the solution of the initial- 
value problem, for if y;(x) and y;(x) are both solutions of the problem, 
é(s) =0 and hence also :(x) =0.] If ¥, and Vv, are respectively approni- 
mate and exact values of the solution, then (4.57) provides an error 
estimate for y,. 


4.9. Error estimation by means of the general theorem on iteration 


Error estimates which depend only on knowledge of a Lipschitz 
function L(x) defined by « 


[1(% 9) — F(a 9*)| S L(x) |y — y*| (4.58) 


and not on bounds for the higher derivatives / lef. (1.23)] may be 
established by means of the general theory of iterative processes dis- 
cussed in Ch. I, § 5.2. We introduce an operator T such that 


P'o(x) =o + J F(E, p(é)) dé (4.59) 
and define a norm in an interval <Xgp by 


le(*)| 
= max : 
| ¢|| Cee > W(x) 3 (4 60) 
where IV(x) is a fixed positive function at our disposal. If / satisfies 
the condition (4.58), we can find a Lipschitz constant W for the operator 
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T as follows: 


IT —Toal =| f ME we) —1E wale ae 
Sf LE)| gi) — 9x6) 28 


= JLOlln— gall W(é) dé; 


therefore 
— | T y2|| S$ K ||. — gall, 
fL( §) W(é) dé 
i nee Way (4.61) 


Provided that K<1, we can now apply the estimate (5.16) of Ch. I — 
at least, in principle. By choosing W(x) =e?* with a suitable value of 4 
we can, in fact, ensure that the condition K <1 is satisfied; for numerical 
purposes functions other than e** may be more suitable. 

If v(x) is any approximation to y(x) with v(x») =y9, we define the 
corresponding ‘“‘defect’’ d(x) as the error in satisfying the differential 
equation: 


d(x) =v'(x) — f(x, v(x)). 
We can express the integral D(x) of the defect as 


= f d(€) d& = v(x) — v(x) — SHE v(é))d& =v —Tv=%—%, 
where 
UL ae), | ae 
Then (5.16) of Ch. I gives an error estimate for the function u(x) = 
v(x) — D(x). 
Example. For the Example I of § 2.6, namely 


2% 


=) — ee, Oj, 
the approximation 
ea 
0 34+7 
yields 
— B53 Se a 49 Bie? 343 l 10 
SG ang” ay In (4 ++ as n (4+ ; x). 


Let the sub-space F (domain of definition of the operator T as used in 
§§ 5.1, 5.2) consist of the continuous functions #(x) in OS **<0-4 which 
8* 
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satisfy 
| « — u#| < 0-001. 
Then in F, L<1-447 (this is the maximum value of eh =4+4 a in F) 
and with W(x) =e?* 
eh ee 
W(x) 2 
this choice of W(x) also gives ||«,— || =0-0006 and with A =Lo= 
0-398, so that = 0-662, (5.16) of Ch. I yields 


1-K 


lly — || < 0-662 x 0-0006 
= 0-0004. 


Since the functions w with 
|| — #,|| <0-0004 lie in F, all 
the assumptions are satisfied 
and the required error estimate 
in 0< *<0-4 is 


ly — #,| < 0-0004e?*. (4.62) 


The actual errors “,— yy and 


u,— y are compared with this 


Fig. II/5. Error estimation by the general theorem on segs : 
iteration limit in Fig. IT/s. 


§5. Finite-difference methods for differential equations of 
higher order 


5.1. Introduction 


Firstly we remark that the general observations made at the be- 
ginning of § 3 on the relative merits of the various approximate methods 
still hold when the methods are applied to differential equations of 
orders higher than the first. 

Secondly we note that for the most part the extension to higher 
orders is achieved by straightforward modifications of the considerations 
for the first-order case (§§ 3, 4). We can therefore be brief. 

An obvious way of dealing with an »-th-order differential equation 
(2.1) is to convert it into a system of » first-order equations 


Vi=Ve, V2=Var Ve=HVareens Vea =%, Yu=F(%, Vis Ver Vos <++2 Vn) 


and treat these by one of the numerical methods already described for 
first-order equations. However, if we do this, not only is the amount 


5.4. Introduction ale) 


of labour involved in the computation greatly increased (thus with the 
finite-difference methods, for example, n difference tables will be needed), 
but also the accuracy suffers; in the case of the finite-difference methods 
this loss in accuracy is due to the fact that ” functions are replaced by 
polynomials instead of their full Taylor expansions in powers of h and 
consequently truncation errors are commited}. Thus the treatment 
of an n-th-order differential equation as it stands offers fundamental 
advantages over the use of the equivalent system of first-order equa- 
tions. For the same reasons a given system of differential equations 
of low order can be transformed with advantage into a system of fewer 
equations of correspondingly higher order, provided that no analytical 
difficulties attend the transformation and that the functions appearing 
in the transformed equations are not too complicated. 
As in § 2, consider the »-th-order differential equation (2.1) 


yaa ys. ee) 
with the initial values (2.2). We assume that the function f satisfies a 
Lipschitz condition of the form 


n—1 
If (x, ys vs OCC yl") —} (x, Bhs ye, OD ET y* Mie = ay yl) (5.4) 


for all pairs of points (x, y, y’,..., y"—), (x, y*, y®’,..., y*@-)) in a 


convex domain D of the (x, y, y’, ..., y'""~) space in which the solution 
and all approximations lie. In practice we often put 
a (y =0,1,...,% —4). (5.2) 


- | ay” fe in D 
Sometimes it suffices to assume that / satisfies the simpler but cruder 
condition 


n—1 
ei. mace, 9, .. yt Mice Ti lpitlmay* |, (5.3) 


where 
A =nexk,. 
5 


As with first-order equations, the calculation consists of two quite 
separate steps: 

1. Approximations y,, yy, ..-, ¥"-), from which values of f/, can be 
calculated, are obtained by some other means for the first few points 
(calculation of “starting values’). 

2. The solution is continued step by step by the finite-difference 
formulae; these give the values of y and its derivatives at the point 
%,4, once the values at x,, x, ,,... are known (“main calculation’’). 
Again we give several such step-by-step procedures (cf. § 5.4 et seq.). 

1 CoL_Latz, L., and R. ZuRMUNL: Zur Genauigkeit verschiedener Integrations- 
verfahren bei gewOhnlichen Differentialgleichungen. Ing.-Arch. 13, 34—36 (1942). 
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5.2. Calculation of starting values 


Substantially the same means are at our disposal here as for dif- 
ferential equations of the first order (§ 3.2): 


I, Using a “self-starting’’ method of integration. As for first- 
order equations, the Runge-Kutta method is foremost in this category 
and, because of the particular importance of accuracy in the starting 
values, is best used with a step of half the length of the main step. 


II. Using the Taylor series for y(a) and its derivatives. (As in 
II and IIa of § 3.2.) 


III. Using quadrature formulae. A set of starting values can also 
be determined by an iterative procedure based on the formulae men- 
tioned in § 2.5 for use as a terminal check. For the first pomt x =a 


we use formulae corresponding to (2.24); thus for 4,, yj,..., vi"? we 
have 
™ m h? m nie a 
yf i= yi a avs 17a See an yl The. 
(5.4) 


p 
ae Wis 2X Yn=m,e At },. 
e= 


The main calculation will normally use second and perhaps also third 
differences, so we need further starting values at %, and perhaps also at 
x3. For these we use the formulae corresponding to (2225). 


peta oe) 
2 2e+1 

(m) 1 9 _ Aer’ ylmt2o+1) 
ene yet 2 (2@+ 1)! yy —- he ™ (Baaee 7 (5.5) 
+1 = = 3 

he ee + BniV? fs) 
m) __ 4,(m) 5 : _ ay(+2 0) 
2S Zany (r= 1,2), 


in which the upper alternative applies when » — 1m is odd and the lower 
when 2 —m is even. These formulae are used iteratively in the usual 
manner: first, rough values of y(", y{"), v”) are obtained, say from their 
Taylor expansions truncated after the term in y, and the corresponding 
values 7,, fo, f, and their differences evaluated; these values are then 
inserted in the right-hand sides of (5.4), (5.5) to give the next approxima- 
tions, on which the process can be repeated. We now examine this 
method in detail for the special case of a second-order equation. 


5.3. Iterative calculation of Starting values for the second-order 
equation y= f(a, y, y’) 


As in § 3.2, we suggest a preliminary scheme suitable for constructing 
rough values at two or three points with which to start the iteration. If 
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starting values are required at only two points x,, x,, the calculation 
represented by the equations framed in dots suffices. 


A. Rough values 


AS =Yothyot+hhty, hi =hyy + hfy; 
: thence A=/(%1.51%), Vi=h—fo: 
2. Wl = yp hyo +h (bf +30), 


6 
hy M=hy +H (fo+3Vh), thence ff), 770! ome 
3. YP = ay! — 9 + 1840, : 
oh oi =hy, + 2h 1), thence fl, Vfl, 7200), : 
Ay yf) = = yi 4 + h2 (ff [0} + +5 ae v2 ne) 
hy) = hy) + (26 +3 r: i). oe 
B. Iterative improvement for vy =1,2,... 
WO = yet hy +b + EVI — AVI +27 7g) 
h yore = hyo +h? (fo+eV i — ae VP +e Vf) 
gray — yy + + et) ee 
yy —— hyo+ MID + 4 VR) | 
i ee i me a (5.9) 
hygt = hyettl + 22(2fh) +472 f2)). . 


The improved values obtained at each stage are used to re-calculate 
the function values {P= f(x ye, aa the differences of these values 
are then formed for use in the next cycle. Very few cycles will be 
necessary if the step interval / is chosen sufficiently small; it should not 
be too large in any case, as has been stressed before (cf. § 3.4). 

The scheme for calculating rough values which was given in § 3.2 
incorporated an iteration on the first two points; this gave better values 
with which to calculate the rough value of y for the third point. Better 
values for starting the iteration B can be obtained here in a similar 
way: the rough values for the first two points are improved by an 
iteration using the formulae framed in B before step 4 is carried out; 
then the improved values are used in step 4 to give better rough values 
for the third point. 

It may be noticed that the form of the equations in A and B is 
such that if y’ does not occur explicitly in the differential equation, 1.e. 
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it has the form y’’=/(x, y), then the calculations to find rough and 
improved values of the y; are not needed at all. 

We now investigate the convergence of this starting iteration, pro- 
ceeding along lines quite analogous to those of § 4.2. We first express 
all the differences occurring in (5.8), (5.9) in terms of function values. 
The iterative scheme then reads 


3 
Y= yo +jhyo +h Yo; ff! 
- (G=1,2,3), (5.10) 
Cat oe PLS 


in which the o;, and t;, have the values given in Tables II/25 and II/26. 
3 


3 
(Checks on the calculation of these numbers are ¥ G,,=4797, X oy =z 
k=0 k=0 


Table II/25. The coefficients OF k Table II/26. The coefficients TR 


wow corm wale fo 


If we subtract from equations (5-10) the corresponding equations 
with » replaced by »y—1 and define f=f,, we obtain 


3 
[vy] __ toa vi s 
P= yt — 9h) AD oi (f— fh-N), 
A= 
fy let — ‘(v+1) ’ fy) : [v] {»—1} 
at — 9; =h 2 tielth aon | ae 
=1 


Bounds for the function differences involved here are provided by the 
Lipschitz condition (5.1) and taking absolute values we have 


3 
APs Zlen| (Rela) [asm | 


' (5-14) 
JO] SD Veja] (Mo LOR *] + Ki [5°]. | 
hol 
Hence the quantities v!"! defined by 
uf = Ke |8)"| + K, Jaf 
satisfy the set of inequalities 
a 
WS 2 (Kol loa] + Kh lel) of G=1,2,3). 5.42) 


k=1 
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If we regard the (positive) numbers 
Ky h?|o;,| + K,h|r;,| = Gp (5.13) 
as the elements of a matrix A, we can apply the theorem quoted in 


§ 4.2 exactly as we did there for the first-order case. This guarantees 
the convergence of the series 


co 


Yop 


y=0 
and hence also the absolute convergence of the iterations for y, and yj, 
provided that all characteristic roots of the matrix A are less than 1 in 
absolute value. 
For a numerical investigation of these characteristic roots we 
introduce the positive parameter ~ defined by 


K,h=pK,h. Khe 


Then the characteristic roots of a \ 


second matrix 


1 
B = aye = (loj4] +2 |t421) 


0 <= i 2p 0 


Fig. 11/6. Plots of the auxiliary function s(p) Fig. II/7. Boundaries correspondingto a sufficient 
condition for the starting iteration (5,8), (5.9) 


will be functions of p only; let the greatest in absolute value be denoted 
by s (since B is a non-zero matrix with non-negative elements, s will 
in fact be positive!). The function s(p) can be calculated point by 
point; the results are shown graphically in Fig. II/6 for the cases of two 
and three starting values. 

Now the condition that all characteristic roots of A should be Icss 
than 1 in absolute value is equivalent to the condition 


sue |. 


1 See G. FroBenius: S.-B. Preuss. Akad. Wiss., Math.-phys. KI]. 1. HBd. 
1912, pp. 456—477, in particular p. 457. 
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Hence the region of the (K,h, K,h?) plane for which convergence of the 
starting iteration is assured (Fig. II/7) is bounded by the curve with 
the parametric representation (parameter #) 


oe so 
Kyt=—5, Kih= (5.14) 


Assuming that h is chosen so small that this convergence condition 
is satisfied, we can estimate the errors in the starting values 
&=Ij—I(%),  G=Vj—y'(%) (7 =1, 2,3). 


Again we proceed along the same lines as for the first-order case (§ 4.5) 
and can be brief. 
For the exact solution we have 


¥(%) = ¥(%0) + hy (%) + WER + VE — aE + £R) +f, 


<< 
& 
| 
SS 
R 
Qo 
| 
<= 
es 
-E 
= 
wo 
os 
-- 
bir 
y 
ea 
le 
oi 


~ (5.45) 


where F'=/(x,, y(x,), y'(x,)). With the notation 


af 
| dx? “a p 


the estimates of Ch.I (2.31), (2.46), (2.47) for the remainder terms 
occurring in (5.15) read 


Z x 4 % . 
MIS ao! M=s, (EIS. MM=%, [EIS ,' oN =s, 
S 19 = c 1 a 4 sa 
Sls, *OM=s, | ASS BM=s, S/S go MNES. 


With all differences expressed in terms of function values we sub- 
tract the two sets of equations (5.15) and (5.8), (5.9) for the exact and 
approximate values, respectively, to obtain the error equations 


As 
=~ I(x) =I Lonlh—F) +045, | 
i (7 = 1,2, 3) ’ 
hae meme dC) h di tin (4; —F) + 8; s; | 


Se=Se+25, S= 5,425, +55, 59 = 5-45), \Oe| 4, jou =ae. 
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Taking absolute values and using the Lipschitz condition (5.1) for 
the function differences /,— F,, we find that 


3 
|e;| #2 |oja| (Kol es + Ka leal) +5; 
: G=1,2,3). (516 
le] Sh Deja] (Kolexl + Kiles|) +5; 


Exactly as with the first-order case, the matrix of this system of 
inequalities is monotonic and the quantities Y,, Yj determined from the 
equations 


3 
¥j= WX loja| (Ko Ys + Ka Ye) +5; 
: 23) 517) 
¥i=h D |tyl Ko% + Ki Ys) +5 


provide upper limits for the absolute values of the errors ¢;, ¢;. 

We can either solve these linear equations for the Y,, Y; or derive 
upper bounds for the Y,, Y; by the method described at the end of 
§ 4.5 for the first-order case. The matrices 


Y; hKloy| AKy|o2{ #Kolors| 4Kilou| #Ky\o..| 4 Kyo4s| Sy 
Y; ome Sick 8 Roce cere 5A io Sy 
we hKy|oy,| AKoloy| ... AKylon{ ca anaes Ss 

fs 5 Ae , S|; % A8 
Y; Koltu! Koltiel Koltis] Ailtul Kiltiol Kilts! Sy (5 ) 
ae Kelfn| -Kelrs| - = - K,]|t3,| oad smells Oe 


correspond here to the matrices Y, KB, S of § 4.5, and if a is the maxi- 
mum value of the elements of A, the method of § 4.5 yields 
ha : , 
[e;| = es S Goer 5 9 ~ (s, + Sp) 


k=1 


(j =1,2,3). (5-19) 


iB! 
’ , Ul h rd 
eh SY S59 + 72 ope 2 + 


We now describe several methods for the main calculation. 


5.4, Extrapolation methods 


Suppose that approximate values y,,j,.-., yf" for the exact 
solution y(x,), Y’(%), +++. ¥" (x,) at the points x, (for @=1,...,7) are 
known and that it is required to calculate approximate values y,,, 
Vr41> ++) Vy) at the next point. 

If in (2.25) of Ch. I we replace » by n—m and 4%, by x, and use the 
fact that y")=/, we obtain a formula for the m-th derivative of the 
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exact solution, namely 


n—m—1 
KY mts 
YX pay) = ae Pree ae) 


y=0 P (5.20) 
ae ne we, eno V? F(x,) = KS ? 
e=0 
in which we have used the notation 
Hx, 9 (x), 9'(x), «+, yD (x)) = F(x). (5.24) 


An estimate for the remainder term Ry m,p41 isegiven im Ch] (2.2F). 
By neglecting this remainder term we obtain FALKNER’S extrapolation 
formula? for the approximate value y),: 
n—m—1 p 
h? Mv. n—m re 
Nit > ae: bi +h UTS (5.22) 
y=0 o=0 
where! f= 7 (4%. Ve. Ve, sae y"—)D). For the special case n=1, m=O, 
this reduces to the Adams extrapolation formula (3.6) for differential 
equations of the first order. For second-order equations (n = 2, m =O, 1) 
we have 
' 1 1 1 1 
=I TR + B+ EVLA EV + A, + 
> (5 -25) 
Y= +A EV St 3 a 


A general formula for the coefficients ,,, isegiven be GPG) GCh. J. 

There are, however, many other ways in which we can set up extra- 
polation formulae. For example, by linearly combining certain formulae 
based on (2.23) of Ch. I we can construct a formula which involves only 
y and f values, i.e. all intermediate derivatives can be eliminated. Such 
a formula is particularly suitable when the differential equation has the 
form y" =} (x, y). 

To derive this formula we take the set of » — { equations obtained 
from (2.23) of Ch. I by putting += +_,,x_2,...,x_,., in turn and multi- 
plying by (— TV igeee i} for x =x_,, and add them. With ‘al = 4 tire 
resulting equation reads 


v (a) — (1) ¥(4a) +(3) 9(@ a) +A) ye a) =P 9 Oe 


p nf (eed) 
= h" yon elo +R, 
where a c= 
me = Fuo(l) + D0 (— Ayr) P, (—a) (5.25) 
q=1 


' FALKNER, V.M.: A method of numerical solution of differential equations, 
Phil. Mag. (7) 21, 621—640 (1936). 
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and 
=r tae n 
R=R, parle) + (— A(T Repealed (5.26) 
q= 


The first few values of the ¢, , are given in Table II/27. 


Table I1/27. The numbers Cae 


= eas s | 51 95 
ule 4 2 12 . 720 «| 288 (5.27) 
n=2 1 0 = 2 ze as 
12 12 240 40 
“> |e ee 
n=4 1 —1 = | 0 ar 


With the remainder term omitted (5.24) provides an extrapolation 
formula for m-th-order equations. It includes the Adams extrapolation 
formula (3.6) and STORMER’s! extrapolation formula 


ee 24, — Vr-1 a 
4 Ne 
+2 (i, +20, + Vt + oe +, +) 
= 29,— Yat lf, + Wt, + Vf, +044, +f) — 


(7*f, + 20%},) +---] 


(5.28) 


240 


as the particular cases m =1 and n =2, respectively; the latter formula 
has been used a great deal on account of its convenient coefficients 
(particularly when fourth and higher differences are neglected). 

For third-order equations the coefficients are even more convenient ; 
in faet sinee (,g—0,,—0, therevare nontermsein V?/ and V*/: 


Va = 39, —3 9-1 r-e (f, ier = Vt, +304, + ee), (5.29) 

1 CarL STORMER, the Norwegian mathematician, was born on the 3rd Septem- 
ber, 1874 in Skien (Norway). He studied in Christiania 1892— 1898, then went to 
Paris 1898—1900, where he became an unsalaried lecturer in 1899, and later 
(1902) to Géttingen. In 1903 he was appointed professor of pure mathematics 
in the University of Oslo. 

In order to confirm his theory of the aurora borealis, StGRMER and his colleagues 
spent several years calculating numerous orbits of electrons in the earth’s magnetic 
field [StORMER, C.: Z. Astrophysik 1, 237—274 (1930)]. The computed orbits were 
reproduced very closely by E. BrUcHE in his experimental work. 

STORMER remarked of the calculations: ‘“One must have ample time and pa- 
tience, for the calculations are extremely long.’’ 4500 working hours were needed 
for 120 orbits. 
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If fourth differences are neglected, we have a very simple yet accurate 
formula which involves only the first differences; provided we do not 
need higher differences for the formulae for y’ and y”’, which may appear 
explicitly in the differential equation, the difference table need not be 
extended beyond the first difference. 

For fourth-order equations also we obtain a very simple formula 
when fourth differences are neglected; the formula (5.24) with »=4 
reads 


Yeti = 49, — 69,1 + 4-2 — V3 + Ps 
' -30 
+m (P4804, py, 4), | : 


720 


5.5. Interpolation methods 


Again suppose that approximate values y™) for the exact solution 
y™ (%_) (m=0,1,...,%—1) at the points x, (o=1,...,7) are known 
and that it is required to calculate approximate values for y'”)(x,_,). 
For the exact solution, (2.36) of Ch. I with » —m in place Of 4% apeqein 
place of x), and y=}, gives 


n—m 


-1 
ne 


Yas) = DS ye.) + 
gal. (5.31) 
si am |) ee VEE es) SR p41» 


e=0 
where F is defined in (5.21), the B*_,,, are given by"(@3e) of Git I, 
and the remainder term is bounded by the limits (2.41) of Ch. I. Omitting 
the remainder term, we obtain the Adams interpolation formula for v" : 


n—m—1 p 


he ™ —m 

Hi Do a ee oe, Ve. (5.32) 
a=0 e=0 

The case n=1, m=O has already been dealt with under the Adams 

interpolation method (3.11) for differential equations of the first order 


(§ 3.3, Il). For » =2 we have 
Vrt1=V thy, + 


tHE as Ab fe Pa gle) ogy 


’ 0 1p i 1 
= a ae nes Vi hier ay has Ps — 24 ail LS | : 
In (5.32) the unknown yi’, appears on both sides (as an argument 


of 7,,, on the right-hand side) and therefore, as in (3.14), we use the 
equation in an iterative form by putting the values for the 1-th iterate 
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into the right-hand side to evaluate the (vy +1)-th iterate in the usual 
way. Thus the iterative form of (5.32) is 


pier 
ee = ee =  ylmto) =r = det. m,o Pe flr! +1? (5.34) 


o=0 


in which the iteration superscripts are again enclosed in square brackets 
to distinguish them from the derivative superscripts. 

Again there are occasions when we need the Lagrangian form of the 
equations in which the differences V°f are expressed in terms of the 
function values; corresponding to the form (3.12) of (3.11) we have the 
Lagrangian form 


n—m—l1 7 Pp 
2 in = y a yim e) ae Ba > | Sane year (5.35) 
e=0 o=0 


of (5.32), in which the new coefficients are given by 


P 
Bicse=(—1)" ¥ Bre(6): (5.36) 


the corresponding iterative form is 


n—m—1 
m) [» he , tm 
al 24) —— pa ar vid) 
e=0 P (5.37) 
at nn” (6x m, 0, Ait a > Ba—m,0,6 fr+1—o} . 
il 


Just as in § 3.3 for differential equations of the first order, other for- 
mulae of the interpolation type can be derived for equations of higher 
order. Thus, for instance, from (2.45) of Ch. I we have 


m h e m 
Tames) = — 9 ‘wet ge | for 
= even 
n—m™m 
+ 2h"— = Sor peel” EEX a) +2R** > 
ae, (5.38) 
2 
i pier? mele 
a, V =! "(x,—4) +2 yo) Gen y' 1 PON) ie fee 
; e=0 odd 
“9 Lb -m. 


ap 2h" Bs al PLEAD Keag) + 2k," m,p 


e=0 


The remainder term lies within the limits given in Ch. I (2.47); if it is 
omitted, we obtain the corresponding equations for the approximation 
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yi”),, namely 


n—m—2 
(m) (m4 SC He, mete) 
yt Oa = » (aal >” a for 
—— ps even 
=o : —m 
a a) sli ps Fy pes ao eis 
Nore (5.39) 
2 2o+1 
yi, = yl"), +2 S PES yh diel for 
et odd 
n—m, 


p 
+ 
ae 20” > Bam dal ave 
o=0 


which describe the interpolation method known as the central-difference 
method. Normally these equations are used with the second sums 
truncated after the term with 9 =1; if the next term with 9 =2 were 
included, the unknown y,_,. would appear in addition to the unknown 
y,41 and application of the method would be very involved!. Thus for 
n =2, for example, we use the formulae 


seen 2p en ee + 4,41) 
| (5.40) 
r= Vpn +h (24, += Why). 


The quantities appearing in these equations for the calculation of the 
values at x,,, are framed in Table II/28, which also gives the required 
factors at the heads of the appropriate columns. The quantities in 


1 At the end of § 3.3, III we mentioned a method for first-order equations due 
to LINDELGF which took into account the fourth difference V4? 9; he applies the 
same idea to second-order equations, rewriting the formula in a similar way: 


1 
Yot1= 29, — Ira tH (f+ (Pt, + Pf) +6, 


where 
b= (Phas APs] 
men i fot oa es) 


If the calculation has proceeded as far as the point x,, temporary values for the 
next two points are found from the formula 


} { : 
A 2Vrt 5 = Ver gait h2 (fe j+ = Vfp4 5+ al Fea i) for 4—O and 41. 
These are used to build up the difference table temporarily so that a value for 6 
can be calculated; this value of 6 determines an improved value of 4,,, and the 
difference table can be filled in permanently up to the point x,,,. LInDELGF 
gives (loc. cit.) a further refinement of this procedure. 
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broken frames are those which are not needed when the differential 
equation does not depend explicitly on y’, ie. when it has the form 
y= (x,y). 


Table I1/28. Central-difference method for differential equations of the second order. 
y= f(x, y, a) 


Factors for y 4 


Factors for hy’ 2 


ity’ if 


To use the equations (5.40) for the calculation of the currently next 
values y,,, and y;,,, we can estimate the as yet unknown value V?/,., 
by extrapolation from the sequence of V?/ values already calculated 
(as in §3.4,1). If we take V?/,+ Vf, as the initial value V?/!},, ie. 
we assume the third differences to be constant and use V3/, in place 
of Vf,.,, then we obtain for y"], the value given by STORMER’s extra- 
polation formula (5.28) truncated after the term in V?/. Proceeding 
from this estimated value V?/!°),, we improve on it successively by 


means of the iterative scheme 


ya = 2%, —% +h (f, +- 5 V*Hs) 
(y =0,1,2,...). (5.41) 


i — hy, 1+ (24, +5 ae 


The step interval h is again to be chosen so small that 

(a) the iterations converge sufficiently rapidly, say in one or two 
cycles, if possible, 

(b) the terms following = V?f,4, and - ane in (5.40), namely 


— a V4f.,and — a V* finn, TESpectively, “nner the approximations 


y,4, and ¥,,, as little as possible. 


For reference we write out the formulae (5.39) in detail for dif- 
terential equations of up to the fourth order (for an equation of order m 


Collatz, Numerical treatment, 3rd edit., 2nd print. 9 
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use the first m formulae with 2 =m): 


WG = 


4 Se 


yin sh) 
Vy—-1 


+h(24,+4 


aa 


Vn no) + 2hyt— + 1 (— E+ 


yt) = ayn) — "5 es t, 


yi? at, dei) 


Example. For the initial-value problem 


vat 


YS Say. 


*, (0) = ¥(0) 
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re tr+1) 
+37 fsa). 
=0, y”(0)=1, 


which arises in boundary layer theory (Example III, § 2.6), we put 


yh=u, 


1 
73 


— =, 


att 


— =w. 


Translated into these quantities the equations (5.42) read 


Pe Nl) ee 


(6w, + V?w,+4), 


1 
Uy44= 2Uy — Uy_y + (6w, + = V0, 41] ’ 


(5.42) 


' 
“Ty V?wr41}) 


The values of y, y’, y’” at the points = +0-1, + 0:2 are calculated from the 
power series! 


Vrt1= Vy—1t 2Uy + (2, ate 


1 cp! 375 
Ta 5 eg ae 


This enables us to fill in the computing scheme in Table II/29 down to the dotted 
line. The values of V3w are recorded so that we can more easily estimate the 


gilli... 


y= 


Table II/29. A non-linear third-order equation treated by the central-difference method 


— eS 


| Estimate 


x y u=hy’ yes y”’ 
—0-2 | 0:02000267 | —0-:02000667 | 0:005 00667 
—0-1 | 0:005 00008 | —0:01000042 | 0-005 00083 

0 |0 0 0:005 

0-1 | 0°00499992| 0:009999 58 | 0-:004.99917 

0:2 |0:019997 33 0-019993 33 0:004.993 34 

0:3 | 0:04497975) 0°029966 28 | 0-:004.977 55 

0-4 |0:07991495} 0:03989366 | 0:004.94698 

0-5 


0°124 74056 


ae 


— 0:000 003 338 


— 833 
0 

— 0:000 000 833 

= 3328 

= 7463 


—0:000013178 


ete 
| + 


2505 
833 | —1671 
833 | — 1667 
2495 | —1662 
4134 1639 4- 
yl 5 


Vw 


p= 15a 


of the 


1 The convergence of this series has been investigated by A. OstRowskr: Sur 


le rayon de convergence de la série de Blasius. C. R. Acad. Sci., 


(1948). 


Paris 227, 580— 582 
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next value of V?w. The procedure is completely analogous to that for a first- 
order equation as in Example II, § 3.5, so fewer lines of working are given. 


Astronomers! employ a method in which columns of the sums 
2}, X&*f,... are used in addition to the columns of the differences 6f, 
6?f,... (these sum columns are formed in such a way that the 3”~!f 
column contains the differences of the 2”/ column). In the case of a 
second-order differential equation y’’=/(x, y), for instance, we build up 
the columns 


x | y he 22} | AD | ny | h? of | h? 07 f h? 6° f 
| 
This we do by using the formula 
= 4 1 
yp =H (Ef, + f,— of), (5.43) 


which follows by two successive summations from the first formula of 
(5.40) with the next term included, i.e. 
Sty, =I (f, +2 d4f,— st of,) 

in central-difference notation. Two arbitrary initial constants are intro- 
duced thereby and these may be determined as follows: if we have found 
y, for r=—1,0,1,2 by some starting procedure (cf. § 5.2), then we 
Know also /, for y——1, 0, 1,2 and hence 6*/, for r=0,1; 2?/, can 
then be calculated for y =0, 1 from the equation (5.43) and this provides 
initial values for the two columns of 2 and 2?/. If the main calculation 
has progressed as far as the values y,, f,, 6?/, ,, we first estimate values 
627.9! and 6?/!°',, then build 6?/,° up to /!°', and calculate y{9!, from 
(5.43). This gives an improved value f!),=/(x,,,, y,°',) and hence also 
an improved value 6?/!!, which can be used to make a better estimate 
6?f,.),. These new values are then substituted in (5.43) to give an 
improved value y!?!,, and so on. 


ig 


5.6. Convergence of the iteration in the main calculation 


As in § 4.1 we investigate the convergence of the iterations involved 
in the interpolative integration formulae by first putting them in 
Lagrangian form with all differences expressed in terms of function 
values. Thus for the Adams interpolation method (5.32) we use the 


1 vy, OppoizER, T. R.: Lehrbuch zur Bahnbestimmung der Kometen und Pla- 
neten, 2nd ed. Leipzig 1880. — HERRICK, S.: Step-by-step integration of 
¥ =f (x, y, z, t) without a ‘‘corrector’’. Math. Tables and Other Aids to Computa- 
tion 5, 61—67 (1951). 

g* 
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expression (5.37) for the (y+41)-th iterate. If we subtract the cor- 
responding expression for the y-th iterate, we obtain an expression for 


the iterative change 
Amy) — ylier i] ae. pnt ; 


namely 
Ame) — [oles eh, ae (ft, a ty) ’ 


From (5.36) and Ch.I (2.40) we see that the factors B¥, which occur 
here are given by 


p 
Bio, p =) Bee =B,,p: 
e=0 
Using the Lipschitz condition (5.1), we have 
n—1 
| 6m) =f ioe K,|6@%-1)| (m =A. a — Ae (5.44) 
o=0 


and if these m inequalities are multiplied by K,, K,,..., K,_,, respec- 
tively, and summed, we find that the quantity 


n—1 
yl — > K, [diel] (5.45) 
e=0 
satisfies the inequality 
vel< CyP—1), (5.46) 
where 
C= h" Bip Ko Sli He Ba, a pital i Op PE pas - (5.47) 


This last inequality has the same form as (4.4) in § 4.1 and by the same 
reasoning as used there it can be shown that the condition C<1 is 
sufficient for the convergence of })v"!. Since we can assume the A, 


v=0 
to be positive, this condition is also sufficient for the absolute conver- 


co 
gence of each of the series 5) 6)! of the iteration process. 
v=0 


For =1 and 2 this sufficient condition for convergence reads 


(for) sad) ; Ah,-a+ : ST wf fe & gt OB, Ky 1, 


(for p =2) PAK at . hk, at 3 Wo Ket «+ ASR een . 


The £,,, decrease as p increases and the restriction on 4 becomes cor- 
respondingly less strict. 

The central-difference method (5.39) can be treated in precisely the 
same way and if fourth and higher differences are neglected, the cor- 
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responding sufficient condition for convergence is 
2 2 FB —», 1| << 1 , 


or, written out more fully, 


AK, 1 aL PKs ae ZK, See 1. (5.48) 


5.7. Principle of an error estimate for the main calculation 


Since error estimates for the various types of extrapolation and interpolation 
methods can all be derived in similar fashion, we restrict ourselves to the con- 
sideration of one particular method, the interpolation method characterized by 
formula (5.32). By subtracting (5.31) from (5.32) and expressing the differences 
in terms of function values as in (5.35), we find that the error 


ef — yl) — yl (x,) 


is given by 
n— wT AP 
a= » a gmt) pe mS BE pitetise — © ges) — Kieave) 
v=0 o=0 


in which the notation (5.21) is used. Since the function / satisfies the Lipschitz 
condition (5.1), we have 


n—m+1), p n—l 
Jel” | es ys yl [eee)| ee De Ver sees | Flew ee 5 ar ’ 
v=0 ; o=0 v=0 
ne; 
n—1 
les | Smee x, Ky Bn —m, pler’}al Sem (5.49) 
=O 
where 
ecu | 
em = >< vem) + p= mS 3 166 fesvemm Le + peer en | 
y=0 o=1 y= 
49) we have a system of m inequalities satisfied by the » absolute errors 
Nan ,| with right-hand sides e,, for which we know upper bounds ae that 
we Wow upper bounds for the earlier absolute errors | e™ )), | el™) eae. Lue 


theorem of Ch. I, § 5.5 which gives sufficient conditions for a monotonic matrix 
is applicable here; in (5.49), 1—A"~" Ky, By, _m,p > 0 [since h will be chosen to 
satisfy the convergence condition C<1 in (5.47)] and all other coefficients on the 
left-hand side are negative. 

Upper limits ym for the absolute errors (¥'") > |e'™)|) can therefore be 


determined from the system of equations 


n—1 
VOR hy Kl, tT En (5.50) 
y=0 
where 
n—m—1 hr , 
En = >» | yer + Ar nS paar eaceeer— a | [Fem 11 
y—0) c=) p= 


Thus it is possible to carry out a recursive error estimate. 
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The step-by-step calculation of these error limits is tedious and does not provide 
a quick general guide to the growth of the error. However, we can also derive 
an independent error estimate as we did for first-order equations in § 4.4 and 
although its strict application is perhaps as tedious as the recursive estimate, we 
can use it crudely to get a rough idea of the growth of the error. 

The derivation of the independent error estimate depends on the fact that 
systems of linear difference equations, of which (5.50) is an example, can be solved 
in the same way as a single linear difference equation (cf. § 4.4). We first obtain 
a particular solution of the inhomogeneous equations (5.50), namely Y, (™) _. con- 
stant = y,,, then add to this solutions of the corresponding homogeneous equations. 
For these we assume the forms 


Sl = Cm2"; 


the constants c,, are then determined from the system of linear equations 


n—1 p n— 1 Rh” i 
C2? ve | > Ka( > Paral o) om ge Ries — 0 | 


me 
»=0 o=0 vy=0 me (5.54) 

(Cie — (0 Wl yisnente, — i 

which are obtained by substituting the above form in (5.50) and dividing through 


by 2’+1—?, These homogeneous equations will have a non-trivial solution only if 
their determinant 


h 2 
ab — 2-1 h" K, By (2) — Poh — i" Ky By(2) a — h* Kz Bo(2) ... 
= ee ‘ 
ght ag Vin Hee OME) 
= “, i} 
—h"-1K,@,(z) 2P— 26-1 ae), —ciie a A"—1 Oi) 
= = 
= <2 (n — 2)! MN Kae Cale | 
—h"—2 K, ®, (2) —W—*K,@,(2) eh — 2-1 8K, (2)... 
Pen iit 290 
sei (n — 3)! — HOEK y—1 Pyle) 
—hK, ®,_,(2) —hK,®,_, (2) —hK,®,_,(2)... 
SP OE Hey Drala) 


vanishes (printing limitations have made it necessary to spread each row of this 
determinant onto two lines). The ®,,(z) introduced in the determinant to shorten 
the notation are polynomials in » defined by 


p 
pas ene —— ®,,, (2) 
a=0 


and depend upon and # as well as upon m and 2. 


D=0 is an algebraic equation for z, in general of the (7 p)-th degree, and has 
in general np roots, say 


24,29, torn p- 


5.8. Instability of finite-difference methods 11535) 


When these are all distinct, the general solution of the difference equation (5.50) is 


np 
YL" = Ym t+ Dil, s% (= 0,1,....08— 13 7 = 0, 1,2,..): (5.53) 

v=1 
In the case of multiple roots the coefficients become polynomials in +; thus if 
241 = 2, = ++ =2,, Say, then we must use (Cy 1+ Cy artes + oe) 24 in place of 


q 


» La ae 


yl 


Eventually, as y increases, the growth of the error limits is determined entirely 
by the root z with greatest absolute value; we can therefore use this root as a 
rough general guide to the rate at which the errors may be expected to grow. 
Even this is quite complicated to deal with in general so we now restrict ourselves 
to the important case of second-order differential equations. For these, equation 
(5.52) reads 
zi? Dp a — 2-2 tg (h? Ky Bo (z) + AK, ©, (z)) + h? Ky Gy (z) + 

+ (AK, — h? Ky) ®,(2) = 0. 


} (5.54) 


For given p we can draw the curves z= constant on a plane with h*K, and hK 
as co-ordinates; these curves will in fact be straight lines since equation (5.54) 
is linear in h? K, and A K,}. 


5.8. Instability of finite-difference methods 


The rough approximations of § 4.7 can obviously be applied in similar 
fashion to differential equations of higher order so we will be brief; in 
fact we limit ourselves to a brief description of the calculations for a 
particular case, namely the central-difference method (5.40) for second- 
order equations?. 

With the same notation (perturbations n, in y,, 4, in y,) and assump- 
tions (in particular that /, and /,, are constant) as in § 4.7 we obtain 
here the variation equations 


Neva = 2%, — Nya + a (My44 + 10, + ya) + 
+ tyler +100; +151), 

Mist = Mp1 +S fyltesa + 4p +1) + 
+ + ly (nr4a + 4 + 17-1). 


Assuming the forms 7,= pA", 7, =41’, we obtain two linear homogeneous 
equations for # and q; for a unique solution their determinant must 


1Cf. Figure 6 in L. Cortatz and R. Zurmtint: Z. Angew. Math. Mech. 22, 
55 (1942). 

2 RutisHauserR, H.: Z. Angew. Math. Phys. 3, 65—74 (1952). — CoLvazz, L.: 
Z. Angew. Math. Phys. 4, 153—154 (1953). 
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vanish, and hence A must satisfy the quartic 
(A — 4) [42 (A? — 1) (A —1) — A(A +1) (A2 +104 +1) 
— 4B(A —1) (A? + 44+41)] =0, 
where A =1*},, B=hf,. 
Under the assumptions made in § 4.7, a perturbation 7 (x) from y (x) 
satisfies the differential equation 


7 = od, +- hy ie 


This has solutions of the form (x) =e“*, where {th =e is a solution 
of the quadratic ert Oo 
Consequently the perturbation 7(x) increases (or decreases when su < 0) 
by a factor A =e? over an interval of length h. If we now compare the 
absolute values of the roots A with the values .1 for given 1 and B 
(Fig. II/8), we can distinguish two regions I and IT in the (4, B) plane. 
In region I, which contains in particular the region /, 20, the maximum 
values of |A| and |A| coincide to a high accuracy (stable region) 


the other hand, in region II there exists the danger of instability. 


On 


5.9. Reduction of initial-value problems to boundary-value problems 


By raising the order of the differential equation and introducing 
further boundary conditions (which may be chosen with considerable 
arbitrariness), we can transform an_ initial-value problem into a 
boundary-value problem, which can then be treated by one of the 
numerous methods at our disposal! (cf. Ch. III). For example, by 


1 pe G. ALLEN, D. N., and R. T. SEVERN: The application of relaxation methods 
to the solution of non-elliptic partial differential equations. Quart. J. Mech. Appl. 
Math. 4, 209—222 (1951). 
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putting y=w’ we can transform 


'=1(%,9), 9 (%) = Yo 
into the second-order boundary-value problem 
u=f(x,w'), U(X) =o, 4 (%) = Hy, 

where x, and x, are arbitrary. 

The transformation can usually be accomplished in several ways; 
for instance, the initial-value problem 

pets), WG) =m y'(a) ism, 

is equivalent to both of the boundary-value problems 
wV—f(x); u"(a)=y,, w"(a)=y,, u(b)=0, #'(b) =0 
and 
yV=H'(*);  y(@)=ya, (a) =%, ¥"(O)=fO), ¥'"(b) =f). 


As yet, insufficient evidence exists for one to be able to recommend 
particularly any definite type of transformation. 


5.10. Miscellaneous exercises on Chapter II 


14. Expand the function y(x) defined by 
, a YC) et 


into a power series and hence calculate its values for x= +04, +0:2. 

2. With the values obtained in Exercise 1 as starting values (thus with h = 0-1) 
use the Adams interpolation formula (3.11) truncated after the third difference 
to calculate approximations y, at several Eyiiliordim pashivn 
further points. Pewee 

3. Determine the ‘‘order’’ (in the sense ; 2 
of § 1.3) of Durrine’s method in § 1.5. 

4. Apply the Runge-Kutta method to 
the following second-order problem, for 


_._ feneral position 


which the function f = — y° does not de- 
pend on y’ and the Runge-Kutta scheme Fig. II/9. Non-linear oscillations of a mass 
therefore reduces to three rows: between two springs 

y= —F; y(0)=02, (0) =0. (5.55) 


(This equation is satisfied by the small oscillations of a mass which is attached 
to two springs in the manner of Fig. II/9 and then disturbed from the position of 
rest!.) 

1 The solution of this differential equation can be approximated in other ways, 
for example, by reduction to a quadrature, and can also be given in closed form 
in terms of elliptic functions. See, for instance, K. KLotrer: Einfiihrung in die 
Technische Schwingungslehre, 2nd ed., Vol. I, p. 138. Berlin-Gottingen- Heidelberg, 
Springer 1951. 
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The solution represents a periodic oscillation and if the period is T, it satisfies 
the symmetry conditions 


T 3 
y(e+ T) = 9(2) = 9(— 9) =~ 9 (> — x). 
Thus we need only calculate y(x) for oS 4< es) i.e. as far as its first zero, for 


y (x) is then known for all x. (Here {T is approximately 10; if the quarter period 
is sub-divided into 5 or 10 intervals, the step interval will be s=2 or h=1.) 
5. Calculate an approximate solution of the initial-value problem 
y(=—#y; yO)=0, y(0)=1, (0) =0 
for 0% <1 using the simple extrapolation formula obtained from (5.29) by neglecting 
fourth and higher differences. Compare the end value with the exact value Sua). 
6. Use the Runge-Kutta method with h=0-2 to compute the solution for the 
interval 0S * <2 of the problem from boundary layer theory, Example IIT, § 2.6: 
y= —yys ¥(O)=70)=0, yAOy=4. 
Compare the end value with the exact value given by the power series solution. 
7. Apply the least-squares method of Ch. I, § 4.2 to the problem 


Y= Cay) 4 7 
for the interval OX <1 assuming an approximate solution of the form i= kot 
with a@=1. The method requires that Faa0 


1 
J (ey) = f (w, — w,)2dx = minimum 
0 


and the a, are to be determined from the equations 


Compare the approximate solution for »=2 and n= 3 with the exact solution. 


5.11. Solutions of the exercises in § 5.10 


1, Insertion of y= —1+a,%-+a,+?+-+- into the differential equation yields 
Oy + 2ag% + Zaye? + +++ = x84 1 — 2,4 4 x* (a? — 2a,) +---. 
and equating coefficients, we find that a%=1, a= 
Table 11/30 —4,=-—1,.... To the eighth power in x the solution is 
Te a 
, 2 
y= —1+ 4% — 284 a ee ee 
3} 6 5 
—0'2 —4°253, 0116.9 404 21 
—O1 | —1:1115133 ae! a8 me ee eee 8, 
0-1 | —0:908 3225 = aaa 
0-2 —0'830881 3 which converges well for small |¥|. The required values 


are given in Table II/30. 
2. The results are reproduced in Table II/31, in which the values above the 
dotted lines are ‘‘starting values’. 


3. A discrepancy appears first with the term in h4. The method is therefore 
of the third order}. 


1 See, for instance, F. A. WILLERS: Methoden der praktischen Analysis, p. 307. 
Berlin and Leipzig 1928, or in the translation: Practical Analysis, p. 377. New 
York, Dover Publications, Inc. 1948. 


5.11. Solutions of the exercises in § 5.40 


z | 7 hf (x, 9) 
—0-2| —1-2530169 | 0-161005 14 
—0O-1| —1°111 5133 | 0°124 54618 

0 —1 0-1 

0:1} —0:908 8225 | 0-083 59583 

0-2| —0-830881 3 | 0:07303637 

0:3| —0-761 2061 | 0:066 94347 

0-4| —0:695 7879 | 006441208 

0-5; —0:631 3749 | 0-064 86343 


Table II/31. 
Adams interpolation formula (3.11) applied to a non-linear first-order equation 


AV} 


—0-036458 96 
— 0-024 54618 
—0:016404 17 
—0:010 55946 
—0:0060929 
— 0:002 5314 
+0°000451 3 


hyp*t 


| 0:01191278 
0:008 14201 


0-003 5615 
0:002 9827 


| AV} 


—0-:003 77077 
—0°002 297 30 
—0:001 3731 
—0:000905 1 
—0:000 5788 
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hvs} 


0:001 473 47 
0:0009192 
0-000 4730 
0-000 326 3 


4. Two calculations are carried out with h=1 and h=2, respectively; they 
are continued until y changes sign. The results are given in Tables I1/32, I1/33; 
all three lines of the Runge-Kutta calculation are given for each step up to ¥= 2 
but for the remaining steps only the first line is reproduced. 


Table II/32. A non-linear oscillation computed by the Runge-Kutta method with h=1 


[aa 


clea 


ky=—t9° 


k 


k’ 

0) 0-2 | 0 | — 0-004 

0°5 0-199 | —0:003 9403 —0:003 9602 
1 0-1960597 | ; = 37683 —0-007 8432 
1 0-1960398 | —0-007 8432 —0-003 7671 

ile 01911764 | _ 34936 —0:003 5848 
2 01847030 | 3 1506 — 0:006 9640 
2 0-1846118 —0-014 8072 —0:003 1458 

3 0:1669257 —0-0202935 | — 23256 

4 | 01445867 —0:0241146 | — 154113 

5 | 0:1191990 —0:0264402 ! — 8468 

6 0:0920821 — 0-027 6418 — 3904 

7 0:0641510 — 0-028 1344 _ 1320 

8 0-035 9308 —0:028 2697 = 232 

9 0:007 6499 — 0-028 2844 — 2 

10 —0:020634 5 —0:0282829 | + 


Table 11/33. The same computation with h=2 


iz y | cine ky= — 29° a 
um 

8) 0-2 | 0 | —0:016 | 

1 0-196 | —0-0150591 | —0:0153727 

2 0-1849409 120544) —0:0296292 

2 0-1846273 | —0-0296292 | — 125868 

4 . 0°1446297 —0:048 2341 = 60507 | 

6 0-092 1318 —0:055 2814 _ 15641 | 

8 0:0359779 —0:0565370 | — 931 

10 | —0:0205907 —0°0565634 | 
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5. The requisite starting values, separated from the following values by a 
dotted line in Table II/34, can be calculated by means of the power series 


2x 2:6x® 2-6-1018 


ii ea aes na 
Table II/34. Application of the extrapolation formula (5.29) 
x y f=—xzy 
—0:2 —0°199 99467 —0:039998 934 

is) 0 (8) 

0:2 0199994 67 — 0-039 998 934 
0-4 0°399 829 34 —0°159931 736 
0:6 0°598 70429 —0°359225 728 
0-8 0°794 54288 —0°635 634 304 
4 0-983 365 67 


this series is also used to calculate the exact values in Table II/35. The main 
calculation is carried out with the formula 
23 
Veta = 397 — Bray tt eae i (fe + fry) 


with h=0-2. 
Table II/35. Exact values 


x | y 


0-4 0-399 829 339 
4 0-983 366 383 


6. Table II/36 gives the results of the calculation. The power series is used 
to calculate 


y (0-8) = 03173143,  y(1) =0:4919304, (2) = 1-78809. 


Table II/36. An accurate Runge-Kutta solution of the Blasius equation 


Oo |0 0 0:02 
0:2; 0:019997 3 | 0:0399867 | 0:0199733 


1-2 | 0-7003698 | 0:2241645 |0-0150553 
1°4 | 0°9388576 02520533 00127840 

04) 0:0799148 | 00797873 | 0:0197879 | 1°6 | 1:2028830 02751759 0-0103241 
1°8 
2 


0°6| 0:1793564 | 0:1189319 | 0-:0192940 
0-8} 0°317 3139 | 0:1566757 | 0:0183708 
1 0-491 9296 | 0:1920829 | 0:0169527 


1-487 5610 , 0-2933679 0-0078912 
1-7880597 | 0-3068944 |0-005688 5 


1 1 1 1 
ar aa ac ar re oa 
2) 1 8 2 
a: g OT eit beeen: 
3 1 2 38) 
eM 
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with the solution 
_ 9000 _ 3780 2485 


4=>—=—, 4, = 5 

1 "3884 2 "884° | 78 “BaR4 

Table II/37 gives w, and w, for several values of x, together with their errors 
(by comparison with the exact solution y = e*). For comparison, w, is also included. 


Table II/37. An application of the least-squares method 


1:221 869 | + 0-000 466 


0:2 1°221 403 1-207 23 —0°01417 

0-4 1:491825 148193 —0:00989 1°491 202 — 0-000 623 
0-6 1°822119 1°82410 +0:001 98 1°821 427 —0-000692 
0:8 2°225 541 2°23374 +0:008 20 2°225970 + 0°000 429 


2°718282 2°71085 —0°007 43 2718258 —0:000024 


Chapter III 


Boundary-value problems 
in ordinary differential equations 


§1. The ordinary finite-difference method 


The basis of the finite-difference method is the replacement of all derivatives 
occuring by the corresponding difference quotients; this is applicable to any 
problem in differential equations. 


1.1. Description of the finite-difference method 


We divide the interval <a, b> in which the solution y(x) of the 
boundary-value problem is sought into m equal parts of length 


_ &=B 


i 


n 


The points x,=a-+<7h are called the ‘‘pivotal points” and h is called 
the ‘‘pivotal interval” or merely the “interval”. 

We characterize the value of a function at the point *;=a+7h 
by a subscript 7 (¢ not necessarily integer); thus y; denotes the value 
of the required function y(x) at the point x;. Further we denote an 
approximation to y; by Y, (see Fig. III/1). 

The first stage of the finite-difference method is to set up a system 
of “finite equations’ from which the Y, can be determined. A finite 
equation is obtained by writing down the differential equation for a 
pivotal point x; and replacing all derivatives which occur by difference 
quotients in some specified way; each derivative is thereby represented 
by a certain linear expression in the Y;. 

Thus (cf. Ch. I, § 2.1) we can replace the derivative y’(%;) by 

ses Aa 
feist, (1.1) 
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the second derivative ’’(x;) by 


Vota — 2¥i+ VYi-a (1.2) 
oo a: 
a derivative y(*)(x;) of even order k by the k-th difference quotient 
1 
7 ee As (1.3) 


and a derivative y'?)(%,) of odd order p by the arithmetic mean of two p-th differ- 
ence quotients: 
a5 (4°Y pun + APY. (1.4) 


The boundary conditions also are put into the form of finite equa- 
tions; these must also be included in the system of equations for the Y,. 


Gime ee) Xj Tn=b Z 
Fig. III/1. Notation used in the finite-difference method 


For example, if we have a boundary-value problem of even order 
with k boundary conditions at the points x =a and x=), we can set 
up a finite equation for each of the pivotal points x, (for / =0, 1, ..., 7) 
and likewise for each boundary condition. In general, besides the 
pivotal values Y; inside the interval <a, b, values of Y at the exterior 
points Xpjo, Xijota, --+» ¥1) Xn y> +++» Xpanig Will be involved; thus we 
have »+k-+4 equations for the same number of unknowns 


a. Ae. Ce 
- Et n+ 
2 > 

This system of finite equations for the ¥, is linear if and only if the 
boundary-value problem is linear. Nothing can be asserted about the 
solubility of the system without being more specific about the boundary- 
value problem. 

Note. We can often specify finite-difference representations other than those 
expressed in (1.1) to (1.4) and thereby arrive at different finite equations. For 
example, the term (f4’)’ can be dealt with either by differentiating the product 
and replacing y’ and y” by their finite-difference representations (1.1) and (1.2): 
— Dee Ve 

h? : 


Veo ye 
oe Cie be SS 4 a ee 
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or by replacing the two differentiations in (fy’)’ by the finite-difference represen- 
tation (41.1): ee 
fray Ht PS 

2h 


We can halve the interval in this last expression, which then reads 


f; Y; —¥)-f, oY 4-3) 
ee it, 4%.) 5) 


The equations which can be set up in these various ways will in general yield 
slightly different results. 


1.2. Examples of boundary-value problems of the second order 


The following worked examples are intended to familiarize the reader with 
the practical application of the finite-difference method and to introduce several 
little artifices and expedients which can often be employed with advantage. A 
further example will be found in Exercise 1 of § 8.11. 


I. A linear boundary-value problem of the second order. Consider the 
bending of a strut (Fig. I1I/2) with flexural rigidity EJ(&) and axial compressive 


Fig. III/2. The bending of a strut Fig. III/3. Finite-difference notation for the bending 
moment distribution 


load P by a distributed transverse load p(&), € being the co-ordinate along the axis 
of the strut. The bending moment distribution M(&) satisfies the differential 


equation 2M : p aa: 
a EJ(§) , 

We will assume here that the transverse load is a constant p but that the flexural 

rigidity is a variabie 


Ej 
E (Emon 
4 = 
+(7) 
» M 
If we take P= =i and introduce dimensionless variables x = = y Rp’ the 
differential equation becomes 
yt(itay=—4, (1.6) 
where dashes denote differentiation with respect to ¥. We take M=0 at each 
end, corresponding to smoothly-hinged end supports, so that the boundary con- 
ditions are W(t) == y (1) | (1.7) 


The interval <—1, 1) is first subdivided rather coarsely into four, 
so that h =} (Fig. III/3); then, making use of the boundary conditions 
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(Y,2=0) and the symmetry (Y,=Y_,), we have 
¥ Soar y, 
he 


(for x = #) ouenite 4S Y=—-1. 


(for x = 0) +Y,=—1, 


With h?=4 the solution of these two simultaneous equations is 


Y%=22=0967, Y= =o0.721. 
Thus, even though it may be rather rough, we have already obtained 
some idea of the bending moment distribution and with a trivial amount 
of computation. 

To obtain more accurate values we must choose a smaller pivotal interval; 
thus if we take h = 3 (pivotal values Yj, Y,, Y, as in Fig. III/3), which gives the 


system of equations 
9(2¥, — 2¥) oF o— —1, 


10 
9(%- 24 +%) + y= — 


1 
(%-2%) +2 ¥%=~-1, 


we obtain the values 


When a large number of subdivisions is used, we do not treat the 
difference equations as a set of simultaneous equations but take ad- 
vantage of the linearity of the problem and treat them as an initial- 
value problem (cf. § 4.3). We start from a value Y")=1 and calculate 
successively from the difference equations the values a. ee 
(for the case h = 1/n), then repeat the procedure, starting froma different 
initial value Y{?)—0, say, and so obtain a second set of values we, 
ea kee Thea the linear combination 


Son ye Voce ye yo) 
Se (3) (i) 
YY, — Yy 


of these two sets of values is the required solution; for it satisfies the 
difference equations on account of their linearity and also satisfies both 
the boundary conditions. In the example under consideration we obtain 
for h=0-1 the values exhibited in Table III/1. 

Improvement by h®-extrapolation. If the finite-difference method has 
been applied to a particular problem with several different values of h, 
the results so obtained can often be improved in the following way. 

We assume that at a fixed point x the error in the finite-difference 
method tends to zero quadratically (for the present case) with h (cf. 
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Table III/1. The lineay combination of two independent solutions of the difference 
equations 


0 0 0:933591 1 6 | 0-641440 | —0-174096 | 0:587281 
1 |0-99 —0:005 0:923923] 7 | 0:513688 | —0-233539 | 0:-464065 
2 | 0-960001 | —0:019950 | 0°894924] 8 | 0:368282) —0:299502 | 0-323935 
3 |0:910018 | —0-044692 | 0-8466171 9 | 0:206836 | —0-370553 | 0-168492 
4 |0-840116 | —0-078946 | 0-779082] 10 | 0-031647 | —0-444898 | 0 

5 |0:750468 | —0:122286 | 0-692510 


§ 3.3). We can then write approximately 
y—YrCh, y—Y*xCh*?, 


where Y and Y* are the values calculated with the intervals 4 and h*, 
respectively. Eliminating the constant C, we derive a new approximate 
value 

4 - Y At? — WAS h? 


YY, (1.8) 


which will in general be a better value. Table JII/2 shows the result 
of applying this A?-extrapolation procedure in the present example to 
the values at x =0. One would therefore take y(0) + 0-9321 as the new 
approximate value. 


Table III/2. h?-extrapolation 


7 
e | 09672 ¥ =0-9337 
1 
4 0:94861 ites 
don | z Y =0-932106 

= | 0°933591 | 


II. A non-linear boundary-value problem of the second order. 
The boundary-value problem 


y=syts yO)=4, y(t) =1 (1.9) 
possesses two solutions, one of which, namely 
_ 4 
y= TH’ (1.10) 


is expressible in elementary terms while the other involves elliptic 
functions. 
Here also we start by using a coarse subdivision of the interval to 
get a rough idea of the solution. With h=% we have the single non- 
Collatz, Numerical treatment, 3rd edit., 2nd print. 10 
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linear equation 
—2Y,+1 
ae 
h? 2 


which gives for y(}) the approximation 


184 43% 
Y= $(-84)184)= | 41-8549 (error + 4-3 %) 


Tet oo. 
With h=% we have two non-linear equations 
3) 
9(4—2%+%) = + ¥2, 
94-2441) => 


for the unknowns Y,, Y, (see Fig. 
III/4). These equations represent 
two parabolas in the (Y,, Y,) plane 
(see Fig. III/5) and their points of 
intersection give the required ap- 
proximate values: 


Y, = 2:2950 (error + 2:0%) 
Y¥,= 1:-4680 (error + 1-9%) 
and 


Y= —4-70 
¥,= —9-72. 


Fig. I1I/4 Fig. I1I/s 
Fig. I11/4. Notation for the finite-difference method applied to the non-linear problem of Example II 


Fig. I11/5. Solution of the algebraic equations 


For finer subdivisions we treat the problem as an initial-value 
problem, as in Example I, by starting from Y,—4 and a guessed value 
of ¥, and calculating the remaining ¥ from the difference equation. 
This is repeated with several different values of }, so that we can inter- 
polate between them for a value which will give a value of Y, satisfying 
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the prescribed boundary condition Y,=1. The calculations with a 
coarse subdivision can be used to find a rough value of Y, for a finer 
subdivision. 

With h=+ we try Y;= 3 and Y,= 2:8 and calculate the first two Y; columns 
of Table III/3 from the difference equations 


Yip1= 006 ¥$+2Y,—¥j, (= 1,2,3,4). (1.44) 


Table III/3. Solution of a non-linear problem by interpolation 


i (6-165 36) 
) 4 4 4 4 4 
1 3 2:8 2°7953 2:79464 }|— 2:5138 
2 2:540 20704 | 2:0594 | 2:05787 |— 8-6484 
3 2°467 | 1°5980 1°5780 1°57519 |—10°2953 
4 | 2759 | 1:2788 | 1.2460 | 1-24138 |— 5-5826 
5 3-509 | 1°0577 1 OW 71 1-00003 1 


From the end values 3-509 and 1-0577 we extrapolate linearly to find the better 
value 2:7953 for Y,, which we use to build up the better approximations in the 
third Y, column; further interpolation yields Y,=2-79464 (from this we build up 
the fourth column; the extra bracketed value at #_, is calculated for an error 
estimate in § 3.4). The last column contains the results of applying the same method 
to the other solution. 

III. An eigenvalue problem. Consider the longitudinal vibrations of a 
cantilever (Fig. III/6). Let its length be /, density g, modulus of elasticity E and 
area of cross-section F(x), where the co-ordinate x j 
is chosen along its axis with the origin at the free 
end. The displacement y satisfies the differential 
equation 


—E(F') y= wr oF y 


and the boundary conditions r=0 x= 
Fig. I11/6. Longitudinal vibrations 
of a cantilever 


WG)! == (OME (A) (OVE 
It is required to find the natural frequencies w. Many other physical problems, 


for example, the torsional vibrations of shafts, give rise to eigenvalue problems 


of similar form. . 
Let the cross-sectional area increase linearly with # from / at the tip to 


2 F, at the base: 
oe 
F(x) =A (1+ 7); 


then with A= 2 and [=1 we have the fully homogeneous problem 


—(itay"—y=—([itavyVHAltitays y'(0)=0, y(1)=0. 


The finite-difference method can be applied in various ways. To 


begin with, there are several different forms of finite equation which 
10% 
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can be used (cf. the note in § 1.1); we choose the form 


(1+ 5h) HFG to 4 Gt + At +7) ¥;=0 


2h (4.12) 
(70, 1,...e—a), 


where h =1/n and A is an approximate value for 4. Corresponding to 
the boundary conditions we put 
cS Se ee Y_,=Y,, and Y, = 0. 
2h 

Thus we have linear homogeneous equations for the » unknowns 
Y), ¥,,---, ¥,-1- For a non-trivial solution the determinant of the 
coefficients must vanish. This requirement yields an algebraic equation 
of the -th degree for A, whose roots A,, A;,...,A,, arranged in 
increasing order of magnitude, are regarded as approximations to the 
first m eigenvalues A,, Ag, ..-, Ay: 


With 4=+4, for example, we obtain the homogeneous equations 
(— 8A), +537 — 0, 


5% +(-12+ 2.4)%~=0. 


The condition for a non-trivial solution yields 


Se oe 


Fig. I11/7. A subdivision which yields => | a 5 
a more accurate finite-difference repre- 2) — 574 oe > A 
sentation of the boundary condition \ 


y‘(0)=0 


from which we obtain 
ee Te A) = 2-836 (error —12%) 
A=8+—/415, ie. e 
+ 3 V 5 AY = 13-164 (error —43%). 
Here A denotes the approximation to the k-th eigenvalue given by the calcula- 
tion with interval h = 1/m. 

A variation is to use a subdivision of the x axis which does not 
include x =0 as one of its points; such a subdivision is obtained, for 
example, if we mark off points from x =14 with h=2, as in Fig, III/7. 
The corresponding finite equations read 


-7¥%+7Y,+A 5 Yy=0, 7%—16%,+4 2 y, 220 


and yield the approximate values 
_ | 3-0651 (error — 4.8%) 


1 = —\4 172 
‘ (19 + 72) 1G°727 (@mior —27°%).. 


In this way we represent the boundary condition y’= 0 at ¥ = 0 more accurately 
than when x = 0 is a pivotal point; this is shown by the fact that the above value 
approximates the first eigenvalue more closely than the value obtained from a 
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Fig. 111/8. Approximations to the normal modes of 
vibration (longitudinal) of a cantilever 
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The results for h 
18 ( -22%), 
32:96 (— 48%). 


A\® = 3-0413 (error —5°5%), 
@),__ 
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A 


A 


is smaller. 


(3) ae 
3 


Here also it is convenient to re- 
duce the boundary-value problem to 
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an initial-value problem when a large number of pivotal points are 
used. We estimate the value of A from the calculations with a coarse 
subdivision and then, starting from Y,—0 and Y,_,=—1 (a factor is dis- 
posable here), use (4.12) to calculate Y, _., Y,_3,.... Ifswe repeat the 
calculation with slightly different values of A, it is usually quite feasible 
to interpolate among them to locate the value which gives Y,=Y_,. 
If we put 2— Ah?=o0, the equations (1.12) for h=% read 
NeW Ni = AD Se 13 
15¥, =Y,0x 16—1-7Y, 
13Y¥, =¥,0x14—41-5Y, 
lo, = THO Se AS 
DY, — 150 a ee 
The calculations for the first two eigenfunctions using these equations in the above 
manner are given in Table III/4. From the form of the equations it can be seen 
that changing the sign of 9 merely changes the signs of Y,, Y,, Y_, and leaves ¥,, ¥4 
unaltered. These sign changes therefore provide us with two more eigenfunctions 
without any further calculation; and since g=0 gives Y,=¥_,=0, this value 
yields a fifth eigenfunction (cf. the table). These approximations to the first five 
exact eigenfunctions are depicted in Fig. II1/8. 
IV. Infinite interval. As an example with a boundary condition at 
infinity we consider the boundary-value problem 
' 1 
pe aad y; V(O)}aate 41 (00 )ueaiQ), 


Pa tS 


Here y(¥) may be interpreted as the temperature difference between an 
infinitely long rod and its surroundings, one end x = 0 of the rod being kept at unit 
temperature and the surroundings at zero temperature. The heat loss to the sur- 


roundings is assumed to be proportional to g(*)y, where p= -_.. 


By means of the difference equations 
Yr 2¥, + Yay WSL Y=0 =1,2,... 
we can express successively Y,, ¥3,... as functions (linear when the 
differential equation is linear, as here) of 31; this first unknown pivotal 
value is then to be determined by the boundary condition y(o) =0. 
Such a boundary condition can be translated into a finite condition in 
various ways: 

1. If we replace the condition y(o)=0 by Y,=0, we obtain an 
approximate value for Y,, and hence also for ¥,, ¥,,..., Y, 4, depending 
on 2. The values of Y, for a series of values of » have differences which 
approximate closely to a geometric sequence, as is shown in Tables III/5 
and III/6 for h=1 and h—}. This facilitates the extrapolation to 
m== oo and indicates that the accuracy of this extrapolation, which 
yields the results y(1) 0-447 and 0-444 for h=1 and 4, respectively, 


1.2. Examples of boundary-value problems of the second order 


Table III/5. Solution by extrapolation from finite boundary conditions. h=4 
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Table III/6. Solution by extrapolation from finite boundary conditions. h=4 


Differences 


| = 0 yields 
Y, = 0-375 
Y, = 0:435 
Y, = 0-4447 
Y, = 0°446 52 | 


Extrapolation 


0-060 
0:010 Y, = 0:4470 


0:0018 


ve Y, = 0 yields Differences Extrapolation 
Yee tc ey, — 41 ¥ —0:465 
Y,;= 3-6583 Y,— 2:1667 Y, = 0-593 ; ae 
¥,= 5°8200¥,— 3°7202 | ¥,=0-6392 ey Sa 

a 0-0190 and hence 

Ye= 9:0728 ¥,— 59714 | ¥=0°6582 | o.oorg |{ y,— 04444 
¥= 14.090 ¥,— 9-3836 ¥, = 0-6660 0:0032 | a 
Y¥,= 21-925 ¥—14-672 | ¥,=0-6692 | 
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is at least as good as the finite-difference method used. To acquire 
greater accuracy and confidence in the results one would repeat the 
calculations with smaller A. Fig. III/9 shows the approximate solution 


with h=F 


2. For large values of x the solution behaves like constant xe~ 


x 


(In complicated cases we put 1/x =u and study the behaviour of the 


solutions of the differential 
equation for small 4.) Thus 
for large n we have 


Yom Ac-**, 
Vg Aemtan 
n +4 
which suggests that we use 
—h —_ 
Ges san Yy — 
Table III/7. Method 2 
n YY, 
2 0-665 
3 06681 
4 0°6702 
5 0-6710 
6 06713 


y 
7 
08 
06 == 
OF 
02 =e = 
0 7 2 3 


ti 


Fig. III/9. Steady temperature distribution in an infinitely 


long rod 


as a finite boundary condition. Using the expressions for Y, in terms 


of Y, calculated above in 1. 


Table III/7; the extrapolated value again yields v(1) = 


for h=}%, 


Y, =0-444. 


we obtain the Y, values of 
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1.3. A linear boundary-value problem of the fourth order 


Under the usual assumptions the transverse displacement 7 (x) of an elastically 
embedded rail subject to a distributed transverse load (Fig. III/10) satisfies the 
differential equation 

ge (EO) Fh) + Kn =a. 
ag? ag? 


Here the € co-ordinate is taken along the axis of the undeformed rail, EJ (¢) denotes 
the flexural rigidity, K is the elastic constant of the bed material and q(é) is the 
g load density. For a rail with both ends 
freely supported, the bending moment Af 
and the shear force Q vanish at the end 
E points =a and =}; thus the boundary 

7 conditions are 

kn 

Fig. I1I/10. Bending of a transversely loaded, dn dn 
elastically embedded rail ase = ae 


=0 for =a and =b. 
For the present numerical treatment of this fourth-order boundary-value problem 
we shall assume the following parabolic distributions of flexural rigidity and load 
density: 

EJ(§) = E fy(2— 47); 9 (E) = Go(2— #4), 


where *=&/l, 21 being the length of the rail and =O the mid-point. Non- 
dimensionalizing 7 and K as well, we have the dimensionless set of quantities 


g E jo S 


7 ae y= 


when k= 40 the boundary-value problem for y reads 


whl aff itt = soe 
[(2 — #4) y’’]’’+ 40y = 2 “7 (4.43) 


(41) =9’"(4+1) =0 


(dashes denote differentiation with respect to x). 
We could now follow the procedure of § 1.1 and without further ado take 


h=1/n and write down the difference equations 


1 
5a AL (2 — (i — 1)?h*) A? Y;_,) + 40 ¥; = 2 — 12h? (§ = 0, 1, 2,..., #) 


, 


in which we put Y_;= ¥; because of the symmetry of the problem, and boundary 
conditions 


Ynti— 2¥,+ ¥,-.=0, 
Yate 2¥na.+ 2Y,-1—- n—g=O. 


We would then have +3 equations for the same number of unknowns. How- 
ever, it is rather more convenient to work with the equivalent system of second- 
order differential equations obtained by introducing the auxiliary quantity 


ae 


v= (2247 


in any case this quantity will be of interest in the calculation of the bending 
stresses, for it is effectively the negative of the bending moment. 
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The second-order system for v and y derived from (1.13) is 
+ 40y — 2+ 27=0, 
ag } (1.14) 
(2 — z*) ’”—v =0; 


and if the symmetry of the problem is used to halve the range of x, the boundary 
conditions become 
v(1) = 0°(1) = 9(0) = v'(0) = 0. (4.15) 


With Y,, V, denoting the approximate values of 4,;, v; the finite-difference repre- 
sentations of these boundary conditions in the case h=} read 


Y..= 


R=, w= = 


1? 


V_, =, 


and with these relations taken into account the difference equations corresponding 
to the equations (1.14) reduce to 


4(2Y%—2X) +40Y,—2 =0, 
4(—24+%) +40¥,—-2 =o, 
4x2, +40Y,—1 =0, 
2x 4(2Y,—2Y,) —% 0, 
1 x4%—2%4+%—% =0 
Solution of this system of equations yields 
3726 
o”” 81440 acini 488 
h=— > = — 00599214 
3421 8144 
Y= — = 0-0420064 a5 
¥,=— —— = — 00386788. 
,  _cpanness er 
2 81440 


Again for emeller values of h it is better, as in Examples I and I], to calculate 


Y,,4.¥% UW .. recursively im terms of Y, and V, and derve two linear equations 
for Y, aud Vy from the conditions V, = and V,-,=Viaey For h=} we obtain 
successively 

¥,= % +o kh 

KU=— 08 Y% + y +0-04 

Y= 0-983674Y, + 0-:0404082% + 0:00081633 

V.= — 32 Yy% +0984 RK +0-1584 

Y,= 0897782Y, +00922076% + 0-:00507613 

V,= — 7°173878Y, +0903347 KR + 0349094 

Y,= 0-636918Y, +0166040 YW + 00178504 

W= — 1254821 ¥, + 0675162 % + 0597266 

Y¥,=  0-:005930¥Y, +0259730 R + 00481913 

Va= — 1901360 ¥, +0181313 RB + 0-871 278 

Y= — 2545249 Y, — 0728104 & + 1-108 183. 
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The equations V, =o and V,= Xj, i.e. 


— 19:01360 ¥, + 0-181 313 % + 0°871278 = 0, 


N 
12-868 28 Y, + 1-403 266 % — 0:510917 = 0, 
then yield 
Y, = 00453317 and %= — 0-0516115. 


With these values of Y and VY, the remaining Y;, V; become 


Y, = 0:0448156, W=—0:0478769, 
Y, = 0:0433224, = —0-0374473, 
Y,= 0:0410152, %=—0-0227336, 
Y, = 0-0381534, W=—0-0080441, 
Y,= 00350551, % 0. 


The correction (1.8) can also be applied here if we assume that the inherent errors 
tend to zero quadratically with the interval h. With h=%, h*=4 it gives the 
improved value Y = 0-045 251 7. 


1.4. Relaxation 


The finite-difference method always entails the solution of a large 
number of simultaneous equations when the pivotal interval is small. 
A numerical solution of such a system of equations can be effected by 
the method! to be described now. It is applicable very generally; it 
can be used for linear and non-linear problems, for ordinary and partial 
differential equations, for the ordinary finite-difference method and also 
for the improved finite-difference methods (see § 2 and Ch. V, § 2). 

The procedure may be outlined as follows: 1. An initial approxima- 
tion is found either by estimation or by rough calculation, say by inter- 
polation from values obtained with a coarse subdivision; 2. this initial 
approximation is inserted in the differential equation to discover where, 
ie. at which pivotal points, the difference equation is already satisfied 
reasonably well and where there are still outstanding residual errors or 
“residuals”’ as they are usually called; 3. corrections are then made to 
the initial approximation at the points where the large residuals occur 
in such a way as to reduce their magnitude (‘‘relaxation" of the initial 


1 This method of solving systems of linear equations had already been used 
by Gauss when it was taken up by Pu. L. SeipEL: Miinch. Akad. Abh. 1874, 
81—108; its convergence was investigated later by R. v. Mises and H. Potiaczex- 
GEIRINGER: Praktische Verfahren der Gleichungsauflisung. Z. Angew. Math. 
Mech. 9, 62—77 (1929), and in recent years it has been applied to a very wide 
range of problems and also expounded in two books by R. V. SouTHWELL: Relaxa- 
tion methods in engineering science, a treatise on approximate computation, 
London: Oxford University Press 1943; Relaxation methods in theoretical physics, 
a continuation of the treatise. London: Oxford University Press 1946, 248 pp.; 
further D. N. pe G. ALLEN: Relaxation methods. New York 1954, 257pp. See 
also our Ch. V, § 1.6. 
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approximation). This relaxation usually produces new residuals at 
neighbouring pivotal points, but by continually decreasing the magnitude 
of the currently largest residual we try to approach the solution of the 
difference equations. 

Experience is essential in making economical use of the method, for 
one has to appreciate the overall effect of making many varied sequences 
and combinations (‘‘group relaxation’’) of corrections to the approximate 
solution to be able to “‘feel ones way”’ quickly towards the exact solution. 
In acquiring such experience by trying various corrections the beginner 
usually gets the impression that the method is difficult, for he often 
has to carry out a long calculation before the residuals become suf- 
ficiently small; but it should be borne in mind that the method permits 
the experienced ‘‘relaxer’’ to produce the solution very quickly to an 
accuracy sufficient for most technical applications. 

A warning will not be out of place here, namely of the fallaciousness 
of the assumption that if the residuals are reduced to zero to a certain 
number of decimals, then the current relaxed values give the solution 
to the same number of decimals; particularly with a large number of 
equations the exact solution can differ widely from the values which 
ostensibly satisfy the equations to the required accuracy. In this con- 
nection it is important to note that in regions where several neighbouring 
residuals have the same sign an overall correction (‘‘block relaxation’”’) 
of considerable magnitude is usually needed to “‘liquidate”’ these residuals 
(che@heeVoehete6). 

Every computer will no doubt devise his own way of arranging the 
work when he has familiarized himself with the method. Consequently 
the layout in Tables III/8, III/9 is only offered as a suggestion. 

For several classes of boundary-value problem one can determine 
rigorous limits for the error in a relaxation solution, cf. Ch. V, § 1.6. 


Example I. A linear boundary-value problem. For the problem 
y’=—1—(44+2)y, y(+1) =0 (1.16) 


of Example I, § 1.2 we choose h = and find rough starting values for 
the relaxation procedure by interpolating graphically (say) between the 
values given by the ordinary finite-difference method with A}. Thus 
from the results of Example I, § 1.2 we obtain the initial approximation 
(with x,= 0-27) 
Yo = 0°97, y= 0:94, Yp= 0°80, Ye = 0-60, 4 = 0:34. 
The difference equations using (1.2) with 4 =1/m read 
Vey 297 Maa — 2 (1 + (4 + h* h*) Vx) : 
yy, , vie 0 (flee0, 1, 05 wm — 1); 


III. Boundary-value problems in ordinary differential equations 


156 


Pe sa U0 |S6S7£-0/L5 065 -0]00 £82-0127 668-086 LE6-0 6526-1195 065-0 90 £8L-027 668-086 L66-0 —, 
(| sl oa | Fl a ee | at 7 
bh $ Zt Ob 9 be HTE-O8P LES -O)LO8LZ2-010S $68-O/G0£E6-0] THTE-O| PL8S-0) SBLZ-0) 68-0} OFE6-O] sanyea man 
be— cyt | tet | tet | ope + |] ep + 
9b+ | 91— zwet zE+ we + | et + yO X 
(Se NS eee raise || (ab See Roe Se suory 
y-OF X cw +/t@ + by — | ve — I] -o02109 
eee Pb tos 
~- — a ‘i KG . 4 , . i . | . ' sonjea 
S ar ||@ ap \ere aris bt GOZE-0| 6085-0} 6722-0} $ 888-0) 9876-0] ZE-0 85-0 LL-0 | 68-0 £60 gunieis 
"e poyja 
e-01X |91—|0 [94 —lo9 —} b€— |rE0EE-0/00665-0lr9 r64-00g716-0,96Z56-0] 90£E-0 0665-0 862-0] ¥£16-0, 8756-0] sanTeA many 
Ly+ t6— | r6— | r6— | 66 — | 16 — 
zet | tb 8+ | st [8 +] +8 + yO} X 
Ke lta oe te— | te — | te — suol} 
eOLx Z0¥—|Zo¥+ FlT— | bIT— -991107) 
Ly +] 66— | $6 + 
68—|£9 [98 |pSt—|46 | 14€€-0| €909-0| 9808-01 9426-01 4626-01 v€-0 | 09-0 08-0 | 66-0 | L6 — 
5 : 9- 8: -O0 | 0) 3un103¢ 
"S poyay 
Gy Ste) v sonjyeA MON 
01 X S W01}99I107) 
69 6 son[ea 
8uTz1e1S 
"T poy 
t¢__ty t4 tg | Tf —lg of 0g 


14 —%z sasueyqy 


Su0I}39eL100 pue sonfea 74 


mazqord nays yuaq ays 40f poysau aouasa{{rp-agrur{ ay 07 paygddv saanpas0ad uoyvxnjas snorsva fo sajdunxq 


*S/III 219eL 


they may be written in the 
form 
Vr =n 
where 
2, = “aoa Tees 
+2 (1+ (04 (447) 
+ RPh) y,). 


The quantity z,—+, repre- 
sents the residual error 
and would normally be 
called the ‘‘residual’”’ and 
denoted by R,. Here it will 
be called the ‘“‘change’’!. 
This terminology arises 
from the close connection 
(cf. Ch. V, § 1.6) with the 
associated iteration pro- 
cedure for solving such 
equations, i.e. the iter- 
ation defined by y*U= 
zi]; thus 2{?]— yl!) is the 
“change” yl?*1)— yl?! pro- 
duced by the (0 +1)-th 
cycle of the iteration. Cal- 
culation of residuals is 
equivalent to performing 
one cycle of the iteration 
procedure and noting the 
changes produced. If the 
y, values satisfied the 


1 Translator’s note. This 
unusual terminology is a di- 
rect translation from the Ger- 
man; it is used here, in spite 
of its seeming awkwardness 
and the existence of a familiar 
alternative, in order that the 
emphasis in the German edi- 
tion on the relationship with 
the iteration procedure may 
be preserved. 
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Table III/9. A relaxation solution of the system of non-linear equations arising in the finite-difference treatment of a non-linear problem 
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difference equations to the number of decimals carried, the changes 
would be zero. 

In Table III/8 the y, values are recorded in the columns on the left, 
the corresponding z, values, calculated from them by (1.17), in the 
central columns and the changes z,— yy, in the columns on the right. 
We now describe several relaxation procedures for reducing the magni- 
tude of these changes. 


1. Point relaxation. Here we simply make such corrections in the y, 
as seem appropriate, dealing with one point at a time. Thus (cf. 
Table III/8) we select the change z, — y,= —0-015 as being particularly 
large and try making a correction of —0-01 in y, (=v_,). The effect 
of this correction is to alter z) by —0-01 (since y_, =1,) and z, by —0-005 
but to leave its own z value z, unaltered since z, is not influenced by 
the term in /? to the number of decimals carried currently; in turn the 
changes are altered as follows: z)— yy) by —0-01, z, — y, by 0-01, 2, — Vp 
by —0-005, and we can write down the new changes immediately without 
having to recalculate the z, values. Continuing this procedure of 
making suitable corrections to the y,, we try to decrease the magnitude 
of the changes as much as possible. 


2. Special block relaxations. Again we first calculate the :, values 
and the changes z, — y, corresponding to the starting values for the \,, 
but this time to one more decimal place. Working in fourth decimal 
units, we begin the relaxation by adding the correction —94 to vo, 
which reduces the first change z)— v, to zero (apart from the error due 
to the neglect of the term in h?, cf. method 1. above); the second change 
2,—%, is therefore altered to —107. We now reduce the remaining 
changes to zero successively by means of special block relaxations, i.e. 
relaxations with simultaneous identical corrections at neighbouring 
points (cf.Ch.V, § 41.6), whose effects depend on the following special 
property of the approximate equation <,— yy=3(vy yy. 1) — ver if 
identical corrections, say of + 2a, are made to the first + y Walues, 
only the 7-th and (r-+41)-th changes are altered, z,—y, by —a and 
2,41— 4,41 by a. Thus we remove the new change z,— y,=—107 by 
adding —214 to yy and y,. At the same time s,— vy, is altered by —107 
to the new value -+-21 (see Table III/8), which can likewise be removed 
by adding +42 to yo, ¥, Ye; and so on. By adding all the corrections 
we obtain new y, values, from which we calculate new 2, values and 
then new changes; these are seen to have been reduced considerably, 
but now they all have the same sign and consequently the new vy, 
values still differ markedly from the required values. One would 
therefore repeat the process on the new v, values with further repetitions 
if necessary. The method depends on the special form of the difference 
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equation for this example but similar methods can be devised for many 
other types of difference equation. 


3. Bracketing and interpolation. Here we aim to find two approximate 
solutions, one with only non-negative changes and the other with only 
non-positive changes. An approximation satisfying the later requirement 
has already been found by method 2. To find the other approximation 
we try new starting values yyp=0-93, y,=--: (as in Table III/8) which 
are likely to be too small; the changes still have varying signs but one 
cycle of the procedure of method 2. yields new y, values (yy=0-933, 
4,=-:+-) for which all changes turn out positive. We obtain a new 
approximation (last row of Table III/8: yy=0-93798, y,=---) with very 
small changes simply by interpolating between the approximations with 
all positive and all negative changes, respectively. The bracketing 
nature of this method allays the fear that the approximate values still 
differ considerably from the exact values, a fear which must otherwise — 
with the first two methods, for example — always exist. 


Example II. A non-linear boundary-value problem, Suppose that we are 
required to find the steady temperature distribution in a homogeneous rod of 
length / in which, as a consequence of a chemical reaction say or some such heat- 
producing process, heat is generated at a rate /(y) per unit time per unit length, 
f(y) being a given function of the excess temperature y of the rod over the tem- 
perature of the surroundings. If the ends of the rod, x =0 and ¥=J, are kept at 
given temperatures, we are to solve the first boundary-value problem 


y’=—ecfly); yvO=%, vlhb=%; 


dashes denote differentiation with respect to x, which is measured along the axis 
of the rod, and ¢ is a given constant. 

For this example we choose an exponential law cf(y)=1-+e¥ for the heat 
generation and y(0)=0, y(1)=1 as boundary conditions. 


The difference equations here are very similar in form to the cor- 
responding equations (1.17) for Example I: with 4—1/m they read 


se. 
‘== 2,, where {ae — (4 +e), (iad), 2,..<;9% — 4), 


Yo = 0, Vn 1. 


We first get a rough idea of the solution with # =, deriving from 
the single equation 

ex=8y,— 5 
f0-9474 
| 2-903 . 

We shall restrict attention to the stable temperature distribution. 
This corresponds here to the solution with the smaller y value, from 


the two real solutions y, = 
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which we obtain by graphical interpolation the starting values y,=0-5, 
Yo= +++, Y= 1-1 (cf. Table III/9) for a relaxation solution with h=}{. 
The relaxation of these y, values proceeds along essentially the same 
lines as for the linear boundary-value problem, the only marked dif- 
ference being that on account of the non-linearity the new y, values 
must be written down and from them the new z, values calculated each 
time a group of corrections is made. Table III/9 needs little explanation 
as it is set out in the same way as Table III/8; after the first few cor- 
rections, the individual steps are omitted and sequences of corrections 
combined and written effectively as group corrections. By continuing 
the relaxation we could obtain a still more accurate solution of the 
difference equations but this would be rather pointless in view of the 
limitations of the ordinary finite-difference approximation. 


§2. Refinements of the ordinary finite-difference method 


In solving problems numerically by the ‘ordinary finite-difference method”’ 
described in § 1, we have seen that a very good idea of the behaviour of the solution 
can generally be obtained by using a large pivotal interval 4 with the attendant 
advantages of relatively short calculations and fewer unknowns. However, we 
have also seen that refining the subdivision (h 0) is a slowly convergent process 
so that to obtain accurate values one would have to use a very small pivotal 
interval. The amount of labour is greatly increased thereby, and consequently 
for accurate work the ordinary finite-difference method does not compare favour- 
ably with other methods. We therefore describe now various ways of improving 
the finite-difference method. 


2.1. Improvement by using finite expressions which involve more 
pivotal values 


We can speed up the convergence of the finite-difference method by 
replacing the derivatives by ‘“‘finite expressions’? which are more 
general than the difference quotients of § 1.1 and represent the deri- 
vatives more accurately. For example, the departure of the expression 


1 
at (— Vi-0e + 8941 — 8 Yi + 5-2) (2.4) 


from /’(x,;) amounts at most to C,h*, where Cy= 35 | [max in Cx #¢41)° 
whereas the departure of the difference quotient 
1 
Sy Yitr— i=) 
from y'(%;) can be as large as C,h*, where Cyg=2 |y"""|nax in Crys, Hey 
Such finite expressions are easily derived by means of Taytor’s theorem. 
For example, if we put 


+2 


¥;% D Vite» (2.2) 
e=—2 
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where the c, are constants to be determined, and expand each term of the sum 
into a Taylor series: 


o*h? 
yt ‘5 


Vite= vit ghy,+ 2 2 


we obtain for the sum the me 


i 2 3 2 
(™ V; oe Co thy; ) Qly+ a0 YA 2 eat aT Vif! 2, eet 
- Q=— e=— 


e=—2 teat 
and by solving the five linear equations 
2 2 2 2 A 
ee ys Qe = 2 ee ofc, = 0, » Uy, 
e=— == == == Ce 


for the five unknown coefficients ¢, we can make the expansion reduce to yy; apart 
from terms in A5 and higher powers of h. The values of ¢, whicn we obtain yield 
the finite expression (2.1). 


2.2. Derivation of finite expressions 


We now generalize the method described in § 2.1. First of all we 
introduce the following 


Definition: Consider the n-th order homogeneous linear differential 


expression - 
Ely] = 21%) ¥” (2.3) 


in y with given continuous functions f,(x) as coefficients. Then the linear 
combination 


p 
A= DC y(ei +h), (2.4) 


where C,, x, are constants, is called a finite expression of the r-th approxima- 
tion for the differential expression L[y] at the point x =x; if the factors 
multiplying the quantities y°)(x;) in the Taylor expansion of the expression 
A are f,(x,) for OSvSn and zero for n+1SySn-47. 

We then state the following 

Theorem: A finite expression of the r-th approximation (in fact, 
infinitely many) can be derived for any given linear differential expression 
L[y] (2.3) at any point x =& and for any non-negative integer r. For an 
arbitrary choice of g=r-+n-+1 distinct points E+a,h (k=1, 2,..., 9), 
g quantities C, can be determined by solving a system of linear equations 
so that, for every function u(x) with a continuous q-th derivative, 


= SGuE beyi) Lime +DaF elm, (2s 


where \9| <1, D is a polynomial in h of at most the n-th degree and depends 
on the choice of the a; but not on u, and |u|... 18 the absolute maximum 
of the q-th derivative A u in an interval containing all the points & +-a,h 
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To prove this we need only apply TayLor’s theorem to the expression 
on the left-hand side of (2.5). This gives 
a Wel ei + | GIES 
+ hu'(e) [a Cte tay Cy) + 
Me'(Qlod Cte tad C)te t+ 


2 
wet (E) fat, +o bostTC,] +R, 


+ 


Rater 
(tnt 
where the remainder term R may be written in the form 
Antrtt (n+7r+1) f ntr+l1 
Re ree : Imax 2, 1% C,| 


with |8|<1. Comparison of this expansion with (2.3) vields (m +7 +1) 
linear equations for the C,, namely 


k! 

Tk < 
Yate, = grin) for OSkSn, 
= for n+1SkSn-t+r. 


These equations always possess a solution, for the determinant of their 
coefficients 


(2.6) 


4 1 ard | 
| 
Oy ely Gna? 
! 
PE ec (2.7) 
| 
at On. awe 


is a Vandermonde determinant, which, being the product of the dif- 
ferences of the distinct numbers «,,..., %,, 1S never zero}. 

Some simple finite expressions for the lower order derivatives using 
equidistant points +h are listed in Table III of the appendix. From 
them finite expressions for any linear differential expression of up to 
the fourth order can be obtained by superposition®. 


1 See, for instance, PERRoN, O.: Algebra, Vol. I, p. 92. 3rd ed. Berlin and Leip- 
zig 1951, or AITKEN, A, C.: Determinants and matrices, 6th ed. p. 44. London: 
Oliver & Boyd 1949. 

4 Closed form solutions of the system of equations (2.6) for m=1 and n=2 
can be found in L. Cottatz: Das Differenzenverfahren mit héherer Approximation 
fiir lineare Differentialgleichungen. Schr. Math. Sem. u Inst. Angew. Math. Univ. 
Berlin 3, 1—34 (1935), and for general » in E. Prranz: Uber die Bildung finiter 
Ausdriicke fir die Losung linearer Differentialgleichungen. Z. Angew. Math. 
Mech. 17, 296—300 (1937). 

Expressions for non-equidistant pivotal points are given by E. PFLanz: All- 
gemeine Differenzenausdriicke fiir die Ableitungen einer Funktion y(x). Z. Angew. 
Math. Mech. 29, 379—381 (1949). 
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2.3. The finite-difference method of a higher approximation 


This method follows precisely the same lines as for the ordinary 
finite-difference method described in § 14 (which can be regarded as a 
first approximation) only now the derivatives are replaced by the finite 
expressions of a higher approximation given in Table III of the appendix. 
However, on account of the extra unknowns appearing in each equation 
based on the higher approximation, there are always more unknowns 
than such equations and further equations of a lower order of approxima- 
tion have to be brought in at the boundary points; these can be equa- 
tions corresponding to the differential equation, for example. This 
device is in fact used in the following example. 


Example I. For the strut problem of ExampleI, § 1.2, ie. 
Pai ya O, iphged) =O, 


the finite equations of the third approximation (see Table III of the appendix) 
for the points x=0 and +=} of the coarse subdivision with h=4} read 


—0+ 16Y,— 30¥,+ 16¥,—0 


12h? eral tot t=O, 

— Ve 16 -O-=mOr pt6Y,—Y. § 
—Y,+1=0; 
12h? eae P 


here we have already used the symmetry condition Y;=Y_; and the boundary 
condition Y,=0. To eliminate Y, we bring in another equation, namely the 
ordinary difference equation for the point *=1: 


Ba 94. 1 = 0. 
2 
Solution of these equations yields 


fou 


Y, = —— = 0:928 844, 
ie) 
543 

Y, = —— = 0°689 962. 
7B 


The more accurate values obtained by taking 4 = 4 are 


2723933 


= we ee = 0-931 437, 
aa Seago 
1 2410848 
= yy, = —-— = 0°824379, 
4= "3° 71~ 2924440 : 
2 296031 
= = —-=(Q: 061 3. 
a - 584888 one 


Example II. An eigenvalue problem. For the eigenvalue problem 


(Q4+x)y% ty +AA+e)y=0, y'(0)=y(1)=0, 
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treated in Example III of § 1.2, the equation for the point #= 2 (with h = %) reads 


5 8 
5 (_¥,— 30%, + 16%—%) + Zo (-%— 7%) + FAN=0 
with the notation of Fig. III/7 (Y; is the approximate value of y ())- 


The unknowns Y, and Y; are eliminated by using the ordinary difference equa- 
tions at the points x =4 and ¥=1: 


4 6 

O4-%) + 3% -W+2A%=0, 

2 4 5 

25 5 _ , Y= y 

= eset egy Ciera, bE: Age Ma: 
For “= + A we obtain the equation 


30968 (error — 3-8%) 


= sp ils 7 : = 
O and from it Am | 30 (ester 16 sae 


583 —1275 + 88y| 


2.4. Basic formulae for Hermitian methods! 


Here we consider another method of setting up finite-difference 
equations of greater accuracy, i.e. with truncation errors of a higher 
order than the ordinary finite-difference equations. The equations we 
obtain are often particularly convenient for differential equations of 
simple form, but sometimes the practical application of the method is 
rather complicated. The gain in accuracy over the ordinary method is 
obtained, not by including more pivotal values, as in the method of a higher 
approximation, but by basing the derivation of each individual difference 
equation on the fact that the differential equation ts satisfied at several 
points, rather than just one as in the other methods. This gives rise to 
formulae which involve the values of derivatives at more than one 
point in addition to the values of the function, and by analogy with 
HERMITE’s interpolation formula we may call them Hermitian formulae 
and methods based upon them Hermitian methods (see footnote); as 
an additional justification for this terminology it may be noted that 


1 Tyanslator’s note. The German name ‘Mehrstellenverfahren’’ does not 
translate conveniently, for ‘‘more-point methods’’ would be rather misleading. 
The name preferred here is suggested by the use of the term ‘‘Lagrangian methods’’ 
for methods involving formulae expressed in terms of function values — by analogy 
with LAGRANGE’s interpolation formula; here the analogy is with HERMITE’s 
interpolation formula, which, in addition to the values of the function, also uses the 
values of the derivative at several points: 


f(x) = DoF (ai) he (*) + D(a) Ai (*) +R; 


cf. HousEHOLDER, A. S.: Principles of numerical analysis, p.194. New York: 
McGraw-Hill 1953. We do not imply that the method described here for solving 
differential equations is directly due to HERMITE. 
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HERMITE’S generalization of TayLor’s theorem (cf. Ch. I, § 2.5) provides 
another example of such a formula. To be more specific, the method 
is based on certain expressions of the form 


b 
P= ZO Yere + A,vit,) 5 (2.8) 
[== 
these are derived once and for all (cf. Table III of the appendix). 

We form linear combinations of the values of y and its &-th deriva- 
tive at neighbouring pivotal points x,;,, and determine the weighting 
factors a,, A, so that the coefficients of powers of h in the Taylor series 
for the expression P centered on the point x; all vanish to as high a 
power of / as possible. Consider, for example, the case k =1 for the first 
derivative. The ordinary difference quotient (1.1) for this case yields 
the relation 

Visi — Vi-1— 2hy; » 0, 


and by substituting the Taylor series for y,;,, and y,_, centered on x; 
we find the error term to be proportional to h? y’’". To obtain a formula 
with an error term of higher order without introducing more pivotal 
points, it is natural to try bringing in the extra “information” provided 
by the values y;,, and y;_,. We take 7=0 for simplicity and try the 
general form 


P=4_1y_1+ 4% Vo +49; + A_1¥-1 + Ao Vo + A113 


then with each term expanded into a Taylor series centered on %) we 
have 


Yo (4-1 +4 + 4) 
+ (—a_, +a,+—[ A_,+49+Aj]} 
pa=J|t Fy ne yy, ( ay +a+2[-Ay + 4y]} 
a 2 he yi (—« , Pay f AN + A,]) 
aL ' na BY ( Bos + ay i : [ -A 1 a 


By putting the quantities inside the round brackets equal to zero we 
obtain a set of linear equations for the unknowns a,, A,. Since the 
equations are homogeneous, a factor remains undetermined and we 
therefore solve in terms of one of the unknowns, say a: 


h 4 
@3=—%, %=0, Ay=4,=— 74 = 7Ao. 
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Thus we obtain the formula 


P , , , 

Zay—ya— Fit 4m ty) =0+00H). 29) 
We treat the general case of a derivative of arbitrary order k in a 

similar fashion. Thus by substituting in (2.8) the Taylor series centered 

on the point x; we have 


p , h? a” 
P= {ao(ys tbl +98 5794 me a 
ame 2! . (2.40) 
+A4,(yP + oh yh +085 yorm + oh, 
and if we define 
kl 
a (2.44) 


the requirement that the factors multiplying y,, y;, y;, ... up to as high 
an order as possible, say the (k +-7)-th, shall be zero leads to the equations 


3 ar =0 Ge 0,152,705 —— 8) 

"a (2.42) 
- as ——~ = 

2, lor th)" ‘=o (¢ =k, k+1,...,% +7) 


for the a, and 8,. 


Clearly we do not want an expression P for which all the 6, vanish. 
This can be avoided by demanding that by, say, i.e. the coefficient 
corresponding to the point x;, does not vanish. Since a factor is in- 
determinate in P, we can put b)=1; then (2.12) becomes an inhomo- 
geneous system of (k +7-+1) linear equations for the unknowns a,, 8,. 
If the number of these unknowns is sufficiently large, which can be 
arranged merely by choosing p sufficiently large, arbitrarily many solutions 
will exist. [The existence of infinitely many solutions follows from the 
fact that to any finite expression derived as in § 2.2 there corresponds 
a solution of (2.12).] Hermitian expressions of the form (2.8) for the 
lower order derivatives (up to the fourth order) are given in Table III 
of the appendix. 


2.5. The Hermitian method in the general case 


Consider the differential equation}: *:$ 


yw). y wae ae (2.43) 


1 By using the associated GREEN’s function E. J. NystrOm: Zur numerischen 
Lésung von Randwertaufgaben bei gewdhnlichen Differentialgleichungen. Acta 
Math. (Stockh.) 76, 157—184 (1944), has developed a special Hermitian method 
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Here we use formula <a with k=n and write down the equations 


3 (4, Yi, +4, YS) j=0 (2.14) 


jap 
for all pivotal points inside the interval, say x,, x, ..., see - 


We now substitute throughout for the Y/”) in terms of the lower 
derivatives Y\"~), Y'*-?),..., Y/, Y, by using the differential equation. 
The Y;°)(1<s<m—1) appear now as further unknowns; we therefore 
write down for each interior pivotal point the formula corresponding 


for the problem y”= f(x, y), y(*,)=¥g, ¥(%») =¥5; he gives formulae for one to 
four interior pivotal points (not necessarily equidistant), in particular, the following 
formulae for three equidistant interior points *,=*,+ih (i= 1, 2,3), where 
h=2(%,— %,): 


3 a a Mt ar ah 

— ar = — [27 yo + 3327 + 2229294 132939 + 794)4 R,, 
¥y apy h? ae a“ a” “en 

y= — 4 gi 0 + 1697 + 26y¢ + 1693 + 94] + Ry, 
Sowa ug we K 

Fee aa = a * Oy + 13297 + 2223 + 3323 + 274] + Rg, 


where y;= y(%;) and R,, R,, R, are remainder terms. 


2 For second-order equations F. Stisst: Numerische Lésung von Randwert- 
problemen mit Hilfe der Seilpolygongleichung. Z. Angew. Math. Phys. 1, 53—70 
(1950), has derived the Hermitian formula 


ye a vf a 
Vi-y — 2VG+ Vig rE (vg_a + 109; + 934.1) 


purely from mechanical considerations based on the funicular polygon of graphical 
statics; he had already used the formula in 1935: Die Stabilitat des auf Biegung 
beanspruchten Tragers. Abh. Internat. Vereinig. f. Briickenbau u. Hochbau 3, 
Ziirich 1935, pp. 401—420, in particular p. 413. In numerous other works he has 
also derived special Hermitian formulae for ordinary differential equations of the 
fourth order and the biharmonic equation, always using an approach based purely 
on ideas from statics; see also F, Sttisst: Baustatik, Vol. I. Basel 1946. The 
Hermitian formula for the second derivative quoted here can also be found in 
Scu. E. MikELADzE: Uber die Lésung von Randwertproblemen mit der Differenzen- 
methode. C. R. (Doklady) Acad. Sci. URSS. 28, 400—402 (1940) (Russian), where 
formulae of the form 


* 
y(atah) + y(a—ah) -y 44 Vath y (a) 4 


7 D4 a+t;h) + y™ (a —1t,h)] + remainder term 
(n =a 


are used; for 2 >2 these are of a somewhat different form from those given in the 
present book. 

3 A variant of the Hermitian method originally due to NumMERov has been 
applied to the special equation y”=q(*)y (cf. G. Strackr: Bahnbestimmung der 
Planeten und Kometen, § 77. Berlin 1929). In this method a system of equations 
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to (2.14) for all derivatives which occur in the right-hand side of the 
differential equation. With the corresponding constants a,, A, distin- 
guished by dashes these equations read 


Dy Magee As age | =O; 

> [a Yin, +4, Y857] 8 =0, 

: (2.45) 
, rate, Vie At v7) —0. 

The boundary points require special attention. Here it may be 


necessary to use unsymmetric formulae in order to eliminate surplus 
unknowns. This is illustrated in Example II below in § 2.6 (see also 


2f)e 
ae 2.6. Examples of the Hermitian method 
I. Inhomogeneous problem of the second order. Let us consider 
again the strut problem of Example I, § 1.2, i.e. 
ya ay iO, Oieeee 0, 
and use first the interval h=4% (Fig. III/3). From Table III of the 


appendix we obtain the equations 


2 a? 4a ” a 
Yin — 2¥,+¥,41— 2 (Wii + 10¥; +¥,1)=0 (¢=0,1) (2.16) 


and from the differential equation 
VS — 1 aaa 
is set up for approximate pivotal values R; of the function 
pe h? ' 
raya ry 4, way (1— 4] 


instead of for approximate pivotal values Y; of the solution (+). By Taytor’s 
theorem we can show that the second central-difference of r(x) has the expansion 


O?r (4) = r(x +h) — r(x) + 7(% —h) = A? y”’(x) — a AS yVT (x) 4 
+ higher order terms. 


y et Ne! : : : 
Now y”=qy=qr (: = = a} , so that if we retain only the first term on the 
right-hand side of the above formula, we obtain the difference equation 
ye 
i“q R. 


ie h2 o 
1— 


A Ry= Ry, —2Ry + Rj 
2 # 


to be satisfied by the approximate pivotal values of r(x). STRACKE uses this 
formula for initial-value problems, but obviously it can also be used for boundary- 
value problems. 
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In addition we have the boundary condition Y,=0 and symmetry 
condition Y_,—Y,, so that finally, after substitution, we have the two 
equations 


2V oY ag (12+10% + 3 ¥,) =0, 
—2%+ Y+2 (12+ Y+F¥,)=0 
for Y, and Y,. Their solution is 


= % =e 


As in § 1.1, we treat the problem as an initial-value problem when 
the chosen pivotal interval is small; thus with h = 4 we use the equations 
300 (2 Y, — 2Y,) +12+42-08Y,+10 Y, =0, 
200(¥, 2%, + Y,)+1241:16Y,1104%,+ Y,=0, 

300 (Y, — 2Y, + ¥,) +12 + 1-36 ¥5 + 11-6 ¥, +1-04 ¥, =0, 
300 (Y, — 2¥5 + Ys) +12 + 1-64 Y, + 13-6 ¥, +1-16 ¥, =0, 
300(¥,-2¥%,+¥%)+12+2 Y,+16-4¥,+1-36Y,=0 


to express Y,, Y,,... successively in terms of Y,: 


1=— 0:0199309+ 0-9799362Y,, 
Y,=— 0-0788659+  0-9190145 Y, 
Y,=— 0-1738941-+ 0-815 4636Y,, 
Y,=— 0-2990990+ 0-6677412Y,, 


302 Y; = —134:1494 +143-9457 Y. 

The boundary condition Y;—0 then yields the value 
Yo = 0-9319450, 

from which we calculate the remaining Y;: 
Y, = 0-893 3157, 
Y, = 0:7776050, 
Y; = 0:586073 2, 
Y, = 0-323 1992. 

As before (§ 1.2) we can use the values ¥,, }* calculated with two 


different intervals, # and h* say, to obtain improved values Y by a 
formula similar to (1.8). Here, however, we assume that the error is 
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of order h* (cf. § 3.3), so that the ae formula is 


Y=Y+—/,(¥—Y*); (2.17) 


ane: 
with h=4, h*= a 


Y = 0-931 945 + THe (0: 931945 — 0-9276) = 0-932060. 


II. An eigenvalue a With 4=2 (notation as in Fig. III/7) we cal- 
culate two eigenvalues of the longitudinal vibration problem 


—(1+4)9%—y=A(1+4)¥;  y’(0) =y¥(1)=0 


of Example III, § 1.2. First of all we write down the Hermitian equation for the 
second derivative at the interior points x=41, 7=#: 


1 ch +t ft 
0 ae Oat 10% oh een Ds 


1 vt ae Ai 
2 oS eis + 10 ¥;’+ Yo’) =0. 


Here we have used the lower order approximation Y,—Y_,=0 for the boundary 
condition y‘(0) =0; this condition also implies that Yj = — Y”, to the same order 
of approximation, but no similar relation holds for the second derivatives. These 
relations are used below when we write down the differential equation at the 
point y= —4. The second derivatives occuring in the Hermitian equations above 
are expressed in terms of the lower derivatives by writing down the differential 
equation for each of the four pivotal points: 


” 1 - ” ’ 
Y3 tare =.0; V+ 2V+A¥=0, 
5 5 


A is an approximate value for A. 


, 


We still have to eliminate the three remaining first derivatives }j.¥,, ¥; and 
for this we use Hermitian formulae for the first derivative — symmetric formulae 
for the points x =%, 3 and a lower order unsymmetric formula (see Table III of 
the appendix) for the boundary point += 1: 


4 Were = (Yisoa Ye bes 
—Y,-—- EE ANY + Yo) = 
2 Tan ee 
ae B per 15 (Yg+¥i) = 


The eliminations yield finally two linear homogeneous equations for Yy and Y,, 
namely 


(— 6870+ 114) Y + (6995 + uw) ¥,=0, 
(4812 + w) ¥)+ (— 11158 + 104) ¥ =0, 


where 3844 = 5yu, and from the usual determinant condition for a non-trivial 
solution we obtain 


vue 3:1677 (error — t-6%), 
(24-111 = (error —6 %). 
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2.7. A Hermitian method for linear boundary-value problems 


For a “‘first’”” boundary-value problem whose differential equation 
does not involve y’ explicitly, as in Example I of § 2.6, for instance, 
substitution from the differential equation into (2.14) immediately 
yields a set of equations for the Y,; on the other hand, if y’ does appear 
in the differential equation, the set of equations derived from (2.14) 
and (2.15) contain the unknowns Y, in addition to the Y,. We now 
describe how a set of equations for the Y, alone can be obtained directly 
for a linear boundary-value problem of the n-th order, even when the 
derivatives y’,..., y'"~! all appear in the differential equation. 


If the functions /,(x) in the linear differential equation 


Uy] = 3 fale) y =r(3) 48) 


possess continuous derivatives of the k-th order, the equation may be 
written in the form 


Ly] =D, fea(e) 9] =r (x), (2.19) 


This may be shown very easily by construction, for if we define sets 
of functions fl successively by forming the sequence of differential 
expressions 


n—1 
L, =L— 7.7)” SF pry fg yi), 
k=0 


I,=1,— Ge "ie = my ‘eu jae 


one eee e. ew 66 (oe eosle) (6) wy ipie se, 6) 6 ©. cee oe 


Ie=L,1—r /9) = y = 009), 


which decrease in order from (m — 1) down to zero, then the result follows 
immediately by addition, and g,=/," “*) with f°/=/,. For n = 2 we have 


Lily] = (fey) + [A — 2f2) ¥)’ + Go-A +h) y =7(x). (2.20) 


Instead of the formula (2.15) for the lower derivatives, we use here 
Hermitian formulae which, though very similar, differ in that the coef- 
ficients of the derivative values (corresponding to A}, Ay,..., A” ”) 
are the same for each derivative and equal to those in (2.14) for the 


1 Following a somewhat differently derived method due to H. SASSENFELD: 
Ein Summenverfahren fiir Rand- und Eigenwertaufgaben linearer ])ifferential- 
gleichungen. Z. Angew. Math. Mech. 31, 240—241 (1951); presented in detail and 
called ‘“‘Quadraturverfahren’’ by R. ZurMUHL: Praktische Mathematik fur In- 
genieure und Physiker, 2nd ed. p. 447 et seq. Berlin-Géttingen-Heidelberg 1957. 
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highest derivatives; thus we derive Hermitian equations of the form 


p 
HY, +A, Yi (Rk =14,...,%—1) (2.21) 
» ae ity 


v=—p 
(we may include the equation with k =n if we put c’”=a,). The coef- 
ficients c\*) are determined in the usual way by making the Taylor ex- 
pansions of the left-hand sides vanish to as high an order as possible; 
for »=2, for example, we establish the formulae 


=e (1 — 240 +) — (v1 +1090 +921) = 044), 


ae (ie 14y, 147 ee (vy, +1079 + y_1) =O, (2922) 
(V1 + 10¥9 + ¥-1) — (Ya + 10% + 9a) = 0. 


[The last equation is included for convenience in writing down equation 
(2.23) below for specific examples. | 


We now form the expression 


5 ACen 


with L[y] in the form (2.19); by virtue of (2.21) we can replace 


p 
2 hs at yee Fit by ae 2 ot) (2, es oe 
v= — vy=—p 


hence, using the differential equation at the points ¥;_ 
obtain 


preesa Vip 


p n 
YS Veni = — EAs tags) (2.23) 


v=—p k=0 y=—p 
which provides the required linear relation between the Y,. 


The number of equations obtained by writing this equation down 
for successive pivotal points x; together with equations representing the 
boundary conditions must always be less than the number of unknown 
pivotal values and consequently further equations are needed. These 
can be obtained by using unsymmetric expressions for points near the 
boundaries; for example, in the case » —2 we can use the set of for- 
mulaet 


= (Y2— 1 — Yo + ¥-1) — (VF Hd yt 41190 +921) = 0004), 
h 


7 Ost 31 — 3 %0— Ya) — (Yat 11 uate 19k) Oat), 
(Yat 119, 21 yomive) (yq/=eled ye 1 Sy _ 1) 10 


1 These, together with formulae for differential equations of the fourth order, 
are to be found in R. ZuRMUHL: Praktische Mathematik fiir Ingenieure und Phy- 
siker, 2nd ed. Berlin-Géttingen-Heidelberg 1957. 
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The boundary conditions themselves likewise require special formulae. 
If, for example, a boundary condition for a second-order problem 
specifies the value of y’ or a linear combination of y and y’ ata 


boundary, a representative finite equation can be derived from a for- 
mula such as 


= 85 Yo + 1084, — 27¥2 + 493 — 664 yo — 18h? yo = 0(h') ; 


we substitute for yj in terms of yg and y, by means of the differential 
equation and then for yo in terms of y, by means of the boundary 
condition (in conformity with the usual notation the y, are to be re- 
placed by the approximations Y; when the remainder term is omitted). 


§3. Some theoretical aspects of the finite-difference methods 


3.1. Solubility of the finite-difference equations and convergence of 
iterative solutions 


In §§ 4 and 2 we described various ways of setting up a system of 
linear equations for any given linear boundary-value problem. Here we 
consider the solubility of such a system but naturally have to restrict 
the generality — after all, not every linear boundary-value problem is 
soluble. If we focus attention on certain classes of boundary-value 
problems, a few additional assumptions suffice to enable us to prove 
the existence and uniqueness of the solution of the finite-difference 
equations. 


We start with a simple example. For the boundary-value problem 
ea ian cee Gal 
yiaj=%, yO)=% 

the ordinary finite-difference method using (1.5) yields the equations 


a [— fey Vota + fey thy) MAM) +6%—7=0 
(§ =1,2,...,.n—4) ¢ G2) 


(3.1) 


Yo= Va» Y, =p. 


If we assume that f(x) >0 and g(x) =O, this system of equations 
satisfies the conditions of Theorem 2 in Ch. I, § 5.5 (in addition to the 
sign distribution, the weak row-sum criterion is satisfied and the matrix 
of coefficients does not decompose) ; hence the system possesses a uniquely 
determined solution for arbitrary values of y,, y, and the 7;. T'urther, 
by Theorem 3 in Ch. I, § 5.5 this solution may be computed iteratively 
in single or total steps, i.e. the single-step and total-step iterations 
converge. 
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We now describe another, quite different, way of showing that a 
unique solution of the system (3.2) exists. With this method the con- 
vergence of the single-step iteration follows at the same time. The 
method is also applicable to certain differential equations of higher 
order, for which, in general, the weak row-sum criterion is no longer 
satisfied. We use the fact that the system of » —1 equations in (3.2) 
(with Y,, Y, not included among the unknowns) is symmetric and 
identify it with the system of equations 

3H =0 Geo a) 
which constitute the necessary conditions for a minimum of the qua- 
dratic function 


0-25 bul B+ S (be 2-7) (3.3) 


of the #—1 variables Y,, Y,,..., Y,-1 (Yo. Y, being fixed at the values 
Var Vr) 

Now under our assumptions that /(x)>0 and g(x) =O, the corre- 
sponding “homogeneous” quadratic form 


t= £5 ba B® “+S Sen with ¥=Y,= 


obtained from Q by putting 7,, Yo), Y,, equal to zero is positive definite: 
obviously it cannot take negative values if the Y, are real and it is zero 
only when all the Y, are zero; for Q*=0O implies that 


bg 


y 


41—Y,=0, sothat Y,=constant, 


and since Y,, Y,, are zero here, the constant must be zero. The determin- 
ant of the quadratic form Q* must therefore be positive. But this 
determinant is also the determinant of the system of equations (3.2) 
and hence that system has a unique solution for any values of 7,, y,, 5. 
According to a well-known theorem!, the fact that Q* is positive definite 
implies also that the solution can be computed by single-step iteration. 
If, instead of (3.1), we have more complicated boundary conditions, 

say 
—Ay(a)+y"(a)=R (3.4) 


at x =a, then the corresponding finite-difference equation reads 


=A Yen aR. 


1 Mises, R. v., and H. PoLLaczEK-GEIRINGER: Praktische Verfahren der Glei- 
chungsauflésung. Z. Angew. Math. Mech. 9, 58—77 (1929). 
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If we also write down the difference equation of (3.2) with i=0, ice. 
—AyYa + fy + fea + 804") Yo — fy Vi = yh, 
we can eliminate Y, between it and the previous equation. The 
resulting relation 
(y+) %—-AN=8B, 
_ (G4? + 2hA f_s) fy rh? —2hf_,R)f, 
leroy Wheat 
between Y, and Y, can be added to the set of symmetric equations of 
(3.2) without disturbing the symmetry. Thus we can still identify the 
system with the minimum equations 6 Q/0 Y; =0 (¢ =0, 1,...,%—1) fora 
quadratic function Q. The appropriate quadratic function now has the 
form 


Om Shales pals SY (sese nH) — fm 


The quadratic form Q* which results when we put Y,=0, 7,=0, R=0 
in Q will be positive definite if, in addition to the previous assumptions 
/>0Oand g=0, we assume further that A =0; for then «=0. This ensures 
also that the weak row-sum criterion is still satisfied; it will not be 
satisfied, however, if g=0 and y’ is prescribed (A =0) at. both end- 
points (the ‘‘second”’ boundary-value problem). 

In general the system of equations arising in the application of the 
Hermitian method of § 2.4 is not symmetric and the quadratic form 
approach is no longer available. In many cases, however, it can be 
shown that the weak row-sum criterion and the other conditions of 
Theorem 2 in Ch. I, § 5.5 are satisfied. As an example we choose the 
special boundary-value problem 

—y"+tx)y=r(%); ya) =u, YO) =%- 
With h= pis, * | x,;=a-+th the associated finite equations (cf. Ex. I, 
n 
§ 2.6) read 
nh? ” ” ” 
Ya ee ee ee a 105 + Y;-1) =0 


VY; =f, Y, 0973; Yo = Va» Y, =p 


? 


where 


and p= \ 


6462 1) 


and yield the system 


Yia(t— tr) —¥ (2+ 24) + ¥s(1- Fh) 


h2 
= =i freee 107;+7;-1)- 


For f(x) > 0 and sufficiently small h, for example, 4 < (12/f)4, the row- 
sum criterion is satisfied. 


176 III. Boundary-value problems in ordinary differential equations 


3.2. A general principle for error estimation with the finite-difference 
methods in the case of linear boundary-value problems 


In principle we can always calculate error bounds for the finite- 
difference methods, for the refined methods of §2 as well as for the 
ordinary method of §1. However, these bounds may be expected to be 
reasonably close to the actual error and to predict its order of magnitude 
correctly only when the solution 1s known fairly accurately; in particular, 
we need to have an approximate quantitive tdea of the behaviour of the 
higher derivatives, which are critical for the error, or if we are using 
maximum values of these derivatives, we must choose upper limits with 
as little over-estimation as possible. Although in general no error esti- 
mates exist which are both sufficiently accurate and sufficiently simple, 
we can at least describe a general procedure by which an error estimate 
is possible. 

As far as we are concerned here the ordinary finite-difference method 
and the method of a higher approximation can be regarded as special 
cases of the Hermitian method of § 2.5, and we therefore consider a 
system of equations of Hermitian form. Thus all equations set up by 
the finite-difference methods for the N unknowns Y,, Y/,..., ¥"~) 
(1 =1,...,p, Say) constitute linear relations between these unknowns 
and the methods therefore lead to systems of equations of the form 


AM — Yay =r (9 =1,2,3,...,N). (3-5) 
v,k 
We naturally assume that these equations have been set up so that the 
determinant of the coefficients ae does not vanish, for otherwise we 
could not have determined an approximate solution. 

We now form the same expressions A‘ for the exact solution (x) 
of the boundary-value problem, whose existence and uniqueness we also 
assume. We then follow the usual procedure of expanding each expression 
into a Taylor series in the values of y and its derivatives at a point 
x =x, and use the differential equation and boundary conditions for 
raising the order of the remainder terms. The resulting equations are 
of the form 


x ale yl) (x,) == rl) 4 B, hre Dayle’ (S) (on "12a. NY, FO) 


where |#,|<1, D, and m, are determinable quantities, and &, is an 
unknown point within the range of pivotal points involved in the g-th 
equation. 


We now derive a system of equations for the errors 


Guay,” ae) (3-7) 
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by subtracting equations (3.6) from (3.5): 
\* k 
2 al, po) = — B, h"e Dy" (E,). (3.8) 
¥, 


Since the determinant was assumed above to be non-zero,these equations 
can be solved. Thus, in so far as the finite-difference method is appli- 
cable at all, the possibility of an error estimate depends on the fact that 
the systems (3.5) and (3.6) have the same determinant. 


For the practical application of such an estimate we often put 


Dye) Os |Pe lmax, (3.9) 


then solve the equations (3.8) for the g‘*) and from the results derive 
upper bounds for the g!") using the fact that |#*|<1. Values for the 
derivatives y'"e) are obtained either by expressing these derivatives in 
terms of lower derivatives, which are known more accurately, by dif- 
ferentiating the differential equation (the order of the derivatives can 
be reduced still further by repeated integration of the differential equa- 
tion) or, less accurately, by using the differences of the Y, in a finite- 
difference derivative formula. 


This is as much as can be said in the general case. That more can 
be proved! if special assumptions are made is shown by the example 
in the next section. 


3.3. An error estimate for a class of linear boundary-value problems 
of the second order 


In illustration of the general procedure just described in § 3.2 we 
derive a general error estimate for the ordinary finite-difference method 
applied to the special class of boundary-value problems defined by 


Llyj=y"+hAyt+hy=r(x); y(@)=%, v(b)=%,, (3-10) 


where y,, ¥, are given boundary values, fy, /,, 7 are functions with 
continuous second derivatives and /,<0 (for positive fy the boundary- 
value problem may not possess a solution). Let the interval 4 be chosen 
so small that 


Zh) <1 for asx. (3-14) 


1 For many boundary-value problems of monotonic type error estimates can 
be obtained in a quite different way which does not require knowledge of bounds 
for the higher derivatives; cf. L. Cortatz: Aufgaben monotoner Art. Arch. Math. 
3, 375 (1952), in which a numerical example with error limits is also given. 


Collatz, Numerical treatment, 3rd edit., 2nd print. 42 
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The corresponding boundary-value problem for the difference equa- 
tions (see § 1.4) reads 


ALY) = Yin 2¥% 4 Ya thig Min Yi the Yr, 
G=1,2450=4), 00 
Ee a ae 
Taylor expansion of A[y,] yields (cf. Table III of the appendix) 


Aly;] =hLly],-.,+R;, (3.43) 


where 
4 
JR, SR* = (2[A9"” roast 19 nan) (3.44) 


From (3.12) and (3.13) the error »,=—Y,—y, satisfies the difference 
boundary-value problem 


Alp] =—R; %=%,=0. (3.45) 
This is a set of m+ 14 linear equations for the »+1 quantities ¢, with 
right-hand sides for which there exist upper limits as given by (3.14). 
From these equations we shall derive upper limits for the quantities 
|;|. The matrix of coefficients satisfies the conditions of Theorem 2 
in Ch. I, §5.5 (sign distribution, weak row-sum criterion, non-decom- 
position), so that 
I¥i— yl =|] Sw, (3.16) 


where the w, are quantities determined from equations —.1[w,) = S, with 
S;2|R;|. Such quantities w; can be obtained by solving the equations 
—A[w,] =1; for then we need only put w,=—R*w*, where R* is defined 
in (3.14). In many cases another way is possible which avoids the 
necessity of solving a second system of equations. This depends on 
being able to find quantities w* for which the numbers —.1/w*] =o, all 
turn out positive (see the following numerical example); we can then 
write 


lo] Sv; =- ie 8 (3.17) 


Numerical example. Let us consider a simple example for which 
we know the exact solution so that the error limits (3.17) can be com- 
pared with the actual errors. Such an example is provided by the 
boundary-value problem 


y"—ly+—=0, y(2)=y(3) =0, 


which has the exact solution 


} 


(19% — 51% — sie I, 


Vv 


1 
Vise 
7 38 
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The pivotal values Y,, Y, corresponding to a coarse subdivision with 
h=4 are calculated from the ordinary finite-difference equations 


—2Y¥,+¥% — 2x8 Y¥,—2Y, 2 
ore ie eee 
as 
= 717 _ 0.043998 (error — 0-000279, i 6% 
“14932 Ss 79, ie. —0-6%), 
208 ‘ ts) 
2 geys = 0-042174 (error — 0:000225, ie. —0-5 7) . 


For the error estimate we need first a value for |y“)| max} the maximum of 
the fourth difference quotient is often used for this, but in the present 
simple case it is better to estimate y’ approximately and use the fact that 


4 t 
ey 24) 2), 
which follows from the differential equation; we find that 


(eee O71. 
Hence from (3.14) 
4 
Rew (2) x SZ w 0-00075. 
We need further a solution of the equations — A[w;*] =o; with positive 


w* and o;. Here these equations read 


100. « * 
oe, ae 2 FD —wt + wh = 0%, 
and we need look no further than the simple values wf =wy =1; they 
51 33. 
cidid,———, & : 
- a a 35 


Then (3.17) yields the error estimate 


|Y;—y,| == x 0-00073 = 0-00074. 


At x,, for example, these limits are about two and a half times greater 
than the actual error. 


3.4. An error estimate for a non-linear boundary-value problem 


In principle, the method described in $3.2 may also be applied to 
non-linear boundary-value problems provided only that the solution y and 
its derivatives y) are known, or can be estimated, sufficiently accurately. 
Usually, of course, we will not be in a position to make the necessary 
estimates of y and y") beforehand and will have to infer their quantitive 
behaviour approximately from the values calculated by the finite- 
difference method. Consequently a rigorous error estimate is out of the 

Pe 
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question and we must be satisfied with approximate error limits. In 
practice, the calculation of such approximate limits is often so laborious 
and the results so crude that it is preferable to dispense with them 
altogether and rely on the indication of the order of magnitude of the 
error provided by the results of two or more calculations with different 
intervals. Thus the procedure does not warrant more explanation than 
is afforded by the following simple example. The problem we consider 
is that of Example II of § 2, i.e. 


tha 


yas Bie 4, 594) 1 - (3.18) 
With 4 = the approximate pivotal values Y, satisfy the equations 
Vir —2Y,4+Y,1.—-F Y?=0 (§=1,2,3,4), (3.19) 
while the exact values y, satisfy the inhomogeneous equations 


Visi — 24; +%1—-RP yi =R, (6 =1,2,3,4), (3.20) 
where 


hs 
[Ril = 7 1 [max in (x¢—1, 4441 ° (3.21) 


The equations for the error ¢,=Y,— \, obtained by subtracting (3.19) 
from (3.20) can be written in the form 


4:%—RA—Vu=R; G=1,2,3,4), (3222) 
where 


4;=2+ 3A (Y,4+ 4), P=Ps=0. (3.23) 


With a=a,a,—1, B=ayaz—1, D=ap —a,dq the explicit solution of 
equations (3.22) for the four unknowns 9; reads 


Do, =R, (4,8 — a) + RB +Rsay +R, 

Dg, =R,B + R,a,B + Ryaa, + Kya, (3.24) 
Do, = R, a, + Ria,a,+ Reagan + Rye, 
Do,y=R, +R,a, +Rsa + R,y(aga—a,). 


We complete the estimate only for the solution without zeros and further 
restrict attention to the point ¢™ 2 (Le. v =0-4). As mentioned earlier, 
we have to make some approximations. Thus we replace the unknown 
exact solution v(x) and its derivatives everywhere by the approximate 
values given by the finite-difference method: the ¥,- v, in the quantities 
a, of (3.23) are replaced by 2Y,, and pivotal values of the fourth 
derivative 


viY = yw 24943 


roto 
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are calculated approximately by replacing the derivatives y; by the 
. : Vga Xie . ’ 

difference quotients 33: the approximate values of the y; so 

obtained are exhibited in Table III/10 together with the “local” maxima 


Table 111/10. Quantities requived in the error estimate (3.24) 


Xj-1 vim1 | Pe in expe. %i41> Y; ay 
1 | oO | 8-43 501 2:79464 | 2-335 
2 h | 4:86 | 169 2:05787 | 2:246 
d 2h | 3:05 | 68 1°57519 | 2-489 
4 3h | 2-04 | 30 1:24138 | 2-149 


of y'Y derived from them. The latter are used in the bounds (3.21) for 
the R;, and from (3.24) with « =4-25, B=3-71, D=10-73, we obtain 
the estimate 

| y2| S 0-0926. 


This limit is about five and a half times greater than the actual error 
WE 0:01705. 


§4. Some general methods 


A series of general methods, especially methods based on error 
distribution principles, were discussed in Ch. I, § 4.2; it will therefore 
suffice here to refer to these methods and give examples. More general 
boundary-value problems for ordinary differential equations have 
already been formulated in Ch. I, §1. 

For our approximation to the required solution y(x) we choose here 
a function w(x, a, ..., 4,) which depends on several parameters d,, ..., ay 
and which already satisfies the boundary conditions independently of 
the choice of parameter values. By inserting w into the differential 
equation we obtain a function e(x,4,,...,a@,) which represents the 
residual error. We then determine the a, in accordance with one of the 
principles mentioned in Ch. I, § 4.2 so that this error function approxi- 
mates the zero function as closely as possible. 


4.1. Examples of collocation 


The collocation method has a very wide range of applicability, is 
simple to use and requires no special previous knowledge. In many 
cases the method yields much more than a rough quantitative idea of 
the solution, in fact the accuracy of the results can sometimes be quite 
remarkable in view of the primitive nature of the method and the slight 
amount of computation involved. 
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Example I. For the problem of Example I, § 1.2: 
Eig ae eey Oe ae te 0 


we use the functions x?"(1 — x?) as satisfying the boundary conditions 
and the symmetry about x=0; thus our approximating function w is 
of the form 


w =a, (1 — x?) + a,(%* — x4) + ag (x4 — x*) ++, 
and substituted in L it yields 
L{[w] =1 +4,(—2 + (4 — *4)) +.4,(2 — 1227 4 «2(1 — x4)) + 
+ ay (12 x2 — 30x4 + x4(4 — x4#)) +---. 


If, for example, we use a two-term expression, i.e. with only two 
parameters a, and a,, we can make L[w]=0 at four symmetrically 
placed points, say x = +} and x = + 3; this leads to the linear equations 


256 4096 


3 337 17881 
{ores +| — 4, —— — 44-—_— = 
( ro ee 256 “24096” 


(ior x=4) (ane + a, 5375 9, 


with the solution a,=0-929254, a,= —0-051146. In Table III/11 these 
results are compared with those obtained by using one-term and three- 
term expressions, respectively, with suitable collocation points. 


Table III/11. Comparison of collocation results as the number of parameters increases 


Collocation Results: 


values of the ay 


p-tern). 
expression 


a, = 0:941 18 
a, = 0°92925, @,= —0:05115 
4, = 0:932088, a,= —0:034108, a,= —0-030221 


Example II. Infinite interval. Another problem considered in § 1.2 
was that of determining the steady temperature distribution in an infi- 
nitely long rod (Example IV); this leads to the boundary-value problem 


Lly] =(2+4)y"—(1+2)y=0; y(0}=1, (co) =0. 


In order to satisfy the conditions at infinity, we choose an approximation 

of the form p 

y Sw) aes”, 
v=1 
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However, this function does not satisfy the boundary condition at x =0 
for arbitrary values of the a, and we must therefore include the equation 


with the collocation equations. 
For p =3 the error function is 


é = L[w] = ae~* + a, (7 +3 x) e-®* +4 a3(17 + 8x) e-3*. 


If, to start with, we drop the term in a,, we can choose just one colloca- 
tion point. Choosing x =1, 
we have 


a,e++ a,10e?=0, 


a + a,=1, 
and hence 
ee 10 
ae 
=o é 
a, = — —_—__, 
10 —e Fig. ITI/11. Curves of the residual error obtained by various 


collocations 


this yields in particular 


To get some idea of how closely the differential equation is satisfied, 
we can draw the corresponding ¢ curve (Fig. III/11, curve a). If x=0 
is chosen as collocation point instead of x =1, we obtain with 


= vb See 
Uy =o 6 


an e curve (curve 0} in Fig. ITI/11) which appears to be an improvement 
on curve a. In spite of this, the y values are worse; for example, 


7e—1 


= 02405 . 
a) = 0-405 


Ww (1) = 
When a, is included and ¥=0 and ¥= 1, say, are used as collocation points, 


we have 
Po OOS Gy = —0°4768, a, = 071163; 


the corresponding ¢ curve is shown in Fig. III/11 as curve c. At x=1 we have 
the good approximation 
153e*— 168e +15 : 
1)e wl) = - oe = 04418. 
eae 10€2(15 —- e) (e— 1) 
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4.2. An example of the least-squares method 


An example of a linear boundary-value problem is treated by the least-squares 
method in § 6.4, so here we confine ourselves to a non-linear example, namely 
the problem (1.9): 

y= Fy; y(0)=4, y(t)=1. 


_For an approximate solution we use the expression 
p=4—3x+a(x— #4), 
which satisfies both boundary conditions for arbitrary a. As the residual error we 
define 
€= — 29" + 3g7= 3 (16 — 244+ 94%?) 4+ 2a(2+4 12% — 21 x? + 925) + 
+ 3a7(#2?— 2254 x4). 
For the least-squares method we now form 
1 
4 
Jl(g] = ff eax = 0: (42966 + 197404 + 3348a?+ 1014+ at); 
a 


since a check on this calculation is desirable, we repeat it with a= 3: 


135126 


il 
€ = 3(20 — 24.424 QO), feax= = 
0 


The least-squares equation 


ra) 
70 et = 4a? + 303424 6696a+ 19740=0 
then yields 
pa jf —smom 
~ | —36:1 + 10-87, 


of which only the real value is significant. With this value a= — 3-4671 the least- 
Squares approximation to the solution at ¥ = +2 is 


p (3) = 1°7332. 


4.3. Reduction to initial-value problems 


As a general method for the numerical solution of boundary-value 
problems which is very useful on occasions we may mention the tech- 
nique of reducing the problem to two or more initial-value problems 
and treating these by one of the methods of Ch. II. (See also the 
examples of § 1.2.) 


In the simplest case of a second-order linear differential equation 


Lly] =7(x) (4.1) 
with boundary conditions 


y(2)=y,, (4.2) 
y(b) =, (4.3) 


4.3. Reduction to initial-value problems 185 


at the points x =a and x=b, we compute the solutions y, and y, of 
the two initial-value problems 


L[yl=r(x); (a) = ya, ree, 
L[y2] =0; ya(a)=0, (a) =1. 


This yields two values y,(b) and y,(b) at x=. On account of the 
linearity of the problem, the solution of the differential equation with 
the initial conditions y(a)=y,, y’(a)=¥, is given by 


(4.4) 


y (x) = 9 (*) + Ya ¥o(X). 
Then if y; is calculated from 


V1 (0) + ¥a¥2(b) =p, 


the boundary condition at x =d will also be satisfied and we have the 
required solution of the boundary-value problem. 

For a fourth-order linear boundary-value problem with equation 
L[y] =r(x) and boundary conditions 


iv. vies, yOhey,, veh, 


one calculates numerical solutions y,, y,, v3 of the following three 

initial-value problems: 

y, from L[yy] =7; ¥,(4) =, (4) =H» V1 (4) =y1'(a) =O, 

yo from L[y,j=0; y2(a)=ye(a)=0, ye(a)=1, ye'(a)=0,/ (4.5) 
=1. 


wer 


ys from L[ys] =0; ys(a) =y3(a) = ya (a) =0, 3 (a) 


The solution of the original boundary-value problem is then given by 
y (x) = ya (x) +94) Yo(*) + 9"(@) ¥a(X) 
if y’(a) and y’’(a) are calculated from the two simultaneous linear 
equations 
41 (b) + y’"(a) vob) + y'"'(4) ¥3(b) = Mo, 
yi (b) +9'(a) yo(b) + 9"""(@) ¥a(b) =. 

Generally, the solution y(x) of an n-th-order linear boundary-value 
problem can always be obtained as a linear combination of the solutions 
V1, Vg,+-. of at most +4 initial-value problems, the constants c, of 
the combination being calculated from a system of linear equations in 
at most unknowns. If the boundary conditions do not permit a con- 
venient special choice of initial conditions such as in (4.4), (4.5), the 
conditions 

; 0 fory+k—1 (VEO, ...,% — 1) 

L[y,}=0, ya) = 


4 for v=k—1 (meni Qe... 7) 
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will always suffice; the functions y,, y2,..., y,, which they define form 
a ‘fundamental system’ for the homogeneous differential equation, and 
with the additional function y,,, determined from 


Ll Yn41] =7(%), vy") (2) =O. (= 015.5, %—1) 


the required solution can be obtained in the form 


y(H) =ynsa(t) + De 90(4). (4.6) 


When we come to non-linear boundary-value problems, linear combi- 
nation is no longer applicable and we resort to interpolation. Thus 
several different solutions y,, y,,... are computed satisfying all the 
boundary conditions at the point x =a and we interpolate among them 
to find one which satisfies the boundary conditions at x =b. 


4.4. Perturbation methods 


Perturbation methods can sometimes be employed with advantage 
when a boundary-value problem with a known, or easily derivable 
solution can be found in the “neighbourhood” of the given boundary- 
value problem}, i.e. such that the values of the coefficients in its dif- 
ferential equation differ only slightly from the corresponding values in 
the given equation. For simplicity we consider here only those 
‘neighbouring’ problems which have the same boundary conditions as 
the given problem, but perturbation methods can also be used when the 
boundary conditions are ‘“‘disturbed”’ as well as the differential equation. 
Attention is further restricted to linear boundary conditions in the form 
given in Ch. I (4.7). 


1 Applications of perturbation methods to eigenvalue problems can be found 
in the following papers: MEYER zUR CAPELLEN, W.: Methode zur angenaherten 
Lésung von Eigenwertproblemen mit Anwendungen auf Schwingungsprobleme. 
Ann. Phys. (5) 8, 297—352 (1931). — Genaherte Berechnung von Eigenwerten. 
Ing.-Arch. 10, 167—174 (1939). — ReExticn, F.: Stérungstheorie der Spektral- 
zerlegung. Math. Ann. 113, 600—619 (1936); 114, 677—685 (1937); 116, 555—570 
(1939); 117, 356—382 (1940); 118, 462—484 (1942). — Naey, B. v. Sz.: Perturba- 
tions des transformations autoadjointes dans l’espace de Hilbert. Comm. Math. 
Helv. 19, 347—366 (1946). — Perturbations des transformations linéaires fermées. 
Acta Sci. Math. Szeged 14, 125—137 (1951). — ScurépeEr, J.: Fehlerabschatzungen 
zur Storungsrechnung bei linearen Eigenwertproblemen mit Operatoren eines 
Hilbertschen Raumes. Math. Nachr. 10, 113—128 (1953). — Fehlerabschatzungen 
zur Storungsrechnung fiir lineare Kigenwertprobleme bei gewOhnlichen Differential- 
gleichungen. Z. Angew. Math. Mech. 34, 140—149 (1954) (with a summary of 
results in a directly applicable form). — ScHAFKE, Fr. W.: Uber Eigenwert- 
probleme mit 2 Parametern. Math. Nachr. 6, 109—124 (1951). — Verbesserte 
Konvergenz- und Fehlerabschatzungen fiir die Stérungsrechnung.  Z. Angew. 
Math. Mech 33, 255—259 (1953). 
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We introduce a perturbation parameter ¢ in such a way that the 
differential equation 


Ge, 2.9,9',9",-.-,9) =0 (4.7) 
has a known solution when ¢ =0 and reproduces the given differential 
equation when ¢=1: 

G1, x,y, y',..., 9) = F(x, y, y’,..., 9) =0. (4.8) 


The differential equation with ¢=0 we call the “undisturbed” equation 
and that with e=1 the “disturbed’’ equation. 

We now assume that the solution » = y(x, e) of the boundary-value 
problem 


G(e,%,9,-.9) =0, Ulyl=y WH12-00) (4.9) 


may be expanded in powers of ¢: 


y (x, €-) = Vo(*) + € 4 (x) + e? ye(x) +-+> (4.10) 


(that this is permissible can probably not be proved with the generality 
considered so far). The first term y9({x) is the known solution of the 
undisturbed equation satisfying the boundary conditions (1.7) of Ch. I. 
If the remaining coefficients y,, y,,... satisfy the corresponding homo- 
geneous boundary conditions, so that 


Ulyl =r, Glyl=O @=1,2,.-.,057=1,2,...), (4-11) 


then the power series (4.10) will satisfy the inhomogeneous conditions. 
We now replace y in the differential equation (4.9) by the series (4.10) : 


G(s, ee hate & Vps sens > eo =O. (4.12) 
7=0 v=0 r=0 


Expansion of the left-hand side in powers of ¢ using TAYLor’s theorem 
(assumed to be a valid procedure) then yields 


00 co co 
G (ex, pai A ae Dey") =D e'G,=0, (4.13) 
7r=0 7=0 s=0 
where the coefficients G, are differential expressions involving the func- 
tions Vy, V,,--+, ¥, and their derivatives; for example, 


Gy = G(0, %, Vo, Yor +++» Yh") =0 
and 


ay Yay 1 ayn) 


aG dG 0G mys 
Se et «2 


When we have calculated y,, y,,... up to y,_1, the equation G,=0 
constitutes, in general, an -th-order differential equation for y,, from 


188 III. Boundary-value problems in ordinary differential equations 


which y, can be determined with the boundary conditions (4.11). Thus 
Yi» Ve, ¥z,--- Can be calculated successively starting with y,, which is 
calculated from yy by means of the linear boundary-value problem with 
the differential equation G,=0 from (4.14) and the homogeneous 
boundary conditions from (4.11). Such a perturbation method is to be 
recommended only when the boundary-value problems for the y, are 
of simple form. 

Example. We consider again the example of the transversely loaded 
strut (I of § 4.2), and write the differential equation in the form 


i User yy +0, 51) 0: 
Then for ¢=1 we have the equation to be solved and for « =0 we have 
a simple differential equation with elementary solution: 


yot%ti=0, Y¥(+1) =0 
with the solution 


Cos + 


a ee 


Substituting the power series (4.10) for y in the differential equation, 
we obtain os 


De" (Yn + In) + DD e727 V_-1 +1 =0, 
n=1 


n=0 
and hence 


Vty,+y,1=0 (n=1,2,...) 


since the coefficients of the powers of ¢ must all be zero. With the 
boundary conditions y, (+1) =0 we have a sequence of boundary-value 
problems from which the functions y,, yg,... can be determined suc- 
cessively. 

The first function y, satisfies 


Wy =x — at, (41) =0, 
and is given by 


yy =e — 2+ su; 7 [(3 * — 2x5) sinx — 3 x*cosx] + A cosx, 


cos 1 


where 
1 


12 cos" 1 


A= (15 cos’? — sin). 


The determination of further y; is more laborious. 
For the value at x =0 the first approximation gives 


Yo (0 
and the second 


) — a Se 
cos 1 


=0-8508 (error —9%) 


Vo (0) +; (0) = —- | a= 3 Caan Me tan 1) =0-9241 (error — 0-8'%). 


cos1 \4 
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4.5. The iteration method or the method of successive approximations 
In this method the differential equation (1.1) of Ch. I for a general 

boundary-value problem is put into the form 
Fy, 9,9, --- 9") = B(x, 9,9", --. 9), (4.15) 


where m<n and F is a convenient, simple function such that the 
boundary-value problem 


a eee, <<, %)) air (x) (4.16) 
with the boundary conditions (1.3) of Ch. I, which we write shortly as 
FOO (PS 472)....9%), (4.17) 


can be solved readily for any right-hand side v(x). If, as is usually 
the case, the given differential equation can be solved for the highest 
derivative which occurs in terms of the lower derivatives, i.e. it can 
be put into the form 


9) NL, VV ye (4.18) 

then one obvious rearrangement of the form (4.15) has K= y) and R=q. 
We can now define an iterative procedure which determines a se- 
quence of functions y9(x), y, (x), ¥2(%), ... in the following manner: yp, (x) 


is chosen arbitrarily, then y,(x), y.(x),... calculated successively as 
the solutions of the boundary-value problems 


Fs, Vue), Vis) ---> VE (4)) 
= F(x, y0(2), v(x). OD), SR =O1,2 0) (49) 
Ve(Yers) = 0 


With this generality nothing can be asserted about the convergence 
of the sequence y, (x) to the solution y(x) of the boundary-value problem ; 
it can happen that the sequence does not converge at all. When it does 
converge, the effectiveness of the method is often influenced considerably 
by the form of the rearrangement (4.15) of the given differential equation 
and by the choice of starting function y g(x); the method is generally 
more effective the closer yg(x) is to y(x). 

The method is often used graphically, particularly in the simple 
form mentioned for equations of the form (4.18). If, for example, we 
have a second-order equation 


y"=9(%, 9,9"), (4.20) 


we first find a starting function y9(x), perhaps by means of the finite- 
difference method, then use a funicular polygon method! to perform 


1 See, for instance, E. KaAMKE: Differentialgleichungen, Lésungsmethoden und 
Lésungen, Vol. I, 3rd ed., p. 164 et seq. Leipzig 1944. 
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the successive integrations which generate the sequence of functions 
V1 (*), Yo(X), «++. 

If &, 4, V, are all linear in y and its derivatives, and if certain 
further assumptions are made, we can specify conditions for the con- 
vergence of the iteration. 

In this case the m-th-order boundary-value problem may be written 
in the form. 


M[y]—aN[y] =r(x), 
U,[y] a7 


where M and WN are linear differential expressions and the U,[y =y,, 
are the linear boundary conditions (1.7) of Ch. I. The corresponding 
iterative scheme is defined by 


M [y¥,41] =aN[y,] + 7(x), U,[¥+1] =u (k =0,1,2,...), (4.22) 


and to examine its convergence we introduce the sequence of functions 
z,(x) defined by 


tees 23559), (4.21) 


2 (*) = Y_(%) — ¥(%); 
these satisfy the corresponding homogeneous iterative scheme 
Mlt4i] =4N [2], U, [241] =0. 


We now make the assumption that z,(x) possesses an eigenfunction 
expansion 


ai(2) = opm) 


in terms of the eigenfunctions 1j,(x) of the corresponding homogeneous 
eigenvalue problem 


M[y]—AN[y]=0, U,[y] =0, (4.23) 


and also that this expansion may be differentiated term by term 1 
times. Then 


aaa) => © egne(s) 
ja 
is a solution of ‘the boundary-value problem 


M[%)=aN[4], U,[z] =0, 
and in general 


= \k 
Se 41(4) © ay! | se cpa (x). (4.24) 
j i 1 7 ts 

Hence the iteration converges for any c; provided that lal<|A,|, 
where A, is the eigenvalue of (4.23) with smallest absolute value; when 
|¢|=|A,|, the iteration diverges for c,+-0, i.e. in general. 
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4.6. Error estimation by means of the general iteration theorem 


In many cases error estimates can be obtained by means of the 
general theorem on iterative processes of Ch. I, § 5; for linear boundary- 
value problems and also for many types of non-linear problem this 
theorem can be used precisely as described in Ch.I, § 5.3. This will 
be amplified to some extent here, although in practice the method is 
effective only for problems which are not far removed from linear; for 
otherwise the Lipschitz constant A required for the estimate can easily 
turn out to be greater than one. In any case, great care should be 
exercised in the determination of A because any increase in K will have a 
considerable adverse effect on the estimate on account of the factor 

K 
ch 
Consider the k-th-order ordinary differential equation 


Eig — PGs ,..., 8") (4.25) 


with linear boundary conditions 
U,[uJ=y, (u¢=1,...,h) (4.26) 


at two points a and b (b >a). Here L[u] is a linear homogeneous differ- 
ential expression in u of order k >s and F is a given function which 
we shall assume satisfies a Lipschitz condition of the form 


Pee ys ce tte) — F(x, tg, Ug,.-., uy)| 


; ) (c) (4.27) 
X Aa(x) [a — ui 


with A,(x)=0. Further we shall assume that the boundary-value 


problem 
L[uj =r(x), U,[4)=0 (uv =1,..05%) (4.28) 


can be solved for any 7(x) by means of a GREEN’s function G(x, &) 
(er, Ch. I, § 3.4): 
b 
eli eeaids (eels) ae: (4.29) 


Finally we assume that this formula for the solution of (4.28) may be 
differentiated s times with respect to x, so that 


ui) (x) = iGo (x,é)7(E)dé (6 =0,1,...,5), (4.30) 


where 
NG (VS) 


ane 


G(x, é) = 
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We now define a transformation T (cf. Ch. I, § 5.3) by Tf =g where 


L(g] = F(x, f.f',.-f°) (4.31) 
i 


Then the difference H =g,— g.=T/,— T/, between two functions g,, g. 
derived by this transformation from two functions /,, /, satisfies the 
boundary-value problem 


ELE =F(%, ffi ft) ~ FG fas fas ID) 
U[H]=0  (w=t,..8), 


and hence by (4.27) 


| H™ (x)| = fox, €) (Geer Ie fy, -- ag 
‘ ; (4.32) 
< J[G%(x,8)] YA) |KO) a8, 
where h=},—f,. If 
||/|| = upper limit ole “pe (x) | (x) (4.33) 


inasxsb = 


where W(x) is a positive, or possibly non-negative, function in aX xb, 
is used as the definition of the norm of a function possessing s con- 
tinuous derivatives, then 


Ss $ b 
eye NN) SUA AC) SCE im “SE 
A Lipschitz constant K for the transformation T is therefore given by 


$ b 
K = upper limit of 5 ae - SA, (x) f |G (x, 6)| We) dé. (4.35) 


inasxsb = 


4.7. Special case of a non-linear differential equation of the second 
order 
As an example we take a second-order differential equation in the 
form 


L[u| = — 0" =F (x, 4,4’) (4.36) 
with the boundary conditions 


(a) = ub) swan. 


a? 
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Without loss of generality we put a =0, and from Ch. I (3.26) the GREEN’s 
function is then given by 


=(6—é for oS*Sé, 
Gime) = 4. (4:37) 
pe 2) for x58. 
For simplicity we will use constant Ay, A, in the Lipschitz condition 
(4.27). If uw’ does not appear explicitly in the differential equation 


(4.36), then A,=0O and the eigenfunction sin —* may be chosen for 
W(x). Since 


b 
i G(x, é) sin ee dt 


_ oe (4.38) 
. me? 
sin a 
(4.35) yields the Lipschitz constant 
2 
Kae (4.39) 


If, however, A,=+0, then this choice for W(x) does not yield a finite 
upper limit in (4.35) and we must choose some other function. Let us 


x 


cya 1 — az wittres = =(1 — Ze then W> 0in0S*Sb fora< 4. 
With 


b 
fG(x,é) W(e) ae bz(1— 2% :) 
Re = max <a 4 eee 
O<xsb , (x) 0s:5} ; (1—az (4.40) 
[G'(x,&) Wie) dé — = a 
= 0 = ek ale eal 
fy a W (x) ee? 4—az 


the Lipschitz constant (4.35) for this case is 
K = Ayky + A, fy. (4.41) 


The calculation is simplified considerably by choosing a =0; then W=1 
and we have 

2 
a et a (4.42) 


As « increases, ky increases but k, decreases, so that it is often possible 
to obtain a sharper estimate for non-zero «; for instance, with 


a = 2 (15 — 133) © 2-314 


Collatz, Numerical treatment, 3rd edit., 2nd print. 13 
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we have! 


K =6 (“27 + 4,0), (4.43) 


2 
where 


— cea re 0-3072. 


For the solution of the differential equation (4.36) with the boundary 
conditions 
“(0)=%,  '(d)=4, (4.44) 


we need the GREEN’s function 
Gy, 6) = 


x for 0S2=é, 
& for €<*=<=0bd 


instead of (4.37). In this case we choose 


- Jtx 
W(«) =sin air 


when «’ does not appear in (4.36), ie. when A,=0; this gives the 
Lipschitz constant 


(4.45) 


Again we must use some other function for W(x) when 1,+0; with 
W(x) =1 we obtain 


eye -- Ae (4.46) 
and with? W(x) =3—6*+4+? 
K =0-636A,b2 +4 A,). (4.47) 


1 Cf. F. LETTENMEYER: Uber die von einem Punkt ausgehenden Integralkurven 
einer Differentialgleichung 2. Ordnung. Dtsch. Math. 7, 56—74 (1944). LETTEN- 
MEYER considers the sequence of functions generated iteratively from [as starting 
funktion u(¥)] the linear function which satisfies the boundary conditions; he 
proves convergence to the uniquely determined solution of the boundary-value 
for the case b2 4 
Ay na + 4, 7g <1. 


Comparison shows that the optimum constant 6?/x* appears also in our (4.39) for 
the case A,=0, but that for the case 4,+ 0 our factor multiplying Ay in (4.43) 
is less favourable than LETTENMEYER’S while our factor multiplying .4, is more 
favourable than his. 

2 For the boundary conditions (4.44) LETTENMEYER (loc. cit.) obtains the 


condition a A,b?+ pape 1. The optimum constant " appears also in our 
n rt Fi 


(4.45) for the case 4,= 0, as before, and for the case 4,+ 0 our factors multiplying 
A, and A, in (4.47) are again, as in (4.43), less and more favourable, respectively, 
than LETTENMEYER’S. 
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4.8. Examples of the iteration method with error estimates 


I. A linear problem. The bending of a strut (Example I of § 1.2) 
is again used as an example; the boundary-value problem reads 


y=—i-—(t+z)y, y(+4) =0, 
and several iteration schemes suggest themselves. 
A. The simplest is defined by 


Yaer=—1—(4+%%)y,, Year(t1)=0 (k=0,1,2,...). 
We start with the function 
Yo(x) = A(A — 4°), 


which satisfies the boundary conditions, and determine the constant A 
so that the first iterate 


15+14A = 1+A 
2 


A 
V(x) = 30 x cs aes x8 


is of the same order of magnitude as y)(x). The condition 
Yo (0) = 9, (0) 


yields A = 42 and y,(0) =¥,(0) =A =0-9375 (error 0-0054). With this 
value of A we have 32y,=30—31 x?-+ x®. 


A second iteration yields 


75379 1 Btieuae) 1 


— le) _ 2h. 4 ae gee) 
—— 2520 oe yan 30 * its oo 
whose value at + = 0 is y,(0) = ee = 0:93476 (error 0-0027). 


To facilitate the evaluation of the next iterate, we simplify y, by neglecting 
the two highest powers of » and approximating the remaining coefficients by 
simpler values: 


4 : 354 
yz = ea) (354 — 3672+ x44 12%), for which y{(0)= a 0:93404. 
A further iteration then yields 
297 009 oom ga e  e, ee eg rae 
*— —__ = - : - -# - x 
DS 340 2 we + EW =F 5 56 15 


whose initial value is 
297 009 
¥3 (0) = ; 


-932934 (error 0:00088). 
aa 934 ( ) 


B. We obtain rather better results if the term —y is taken over to 
the left-hand side, i.e. if we use the iteration formula 


Vera t+ Vera = —1—3°4,, Yeti (d:1) =0 ee 
3 
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With the same starting procedure as in A, i.e. putting 


yo(x) =A(1—x*), —¥0(0) =" (0), (4.48) 
we find that 
yy (2) = —1 + A(26 — 13.22 + xt) + 4— A cos x; 
here 
4, (0) =A = el 0-933505 (error 0-001 45). 


14 — 25 cos1 


C. The iteration can be improved still further by making a constant- 
coefficient approximation for the term x*y, say 4y, and taking this 
over to the left-hand side as well. We obtain the slightly modified 
iteration 


Hert y= = +(-—#) ye» Yerr(t1)=0 (k=0,1,...), 


which, with the same starting procedure as before, yields 


— 2 a iF 
A761 = AOB5 ett 1009 7) ACOSO deez, 


125 125 cos@ 


4 
V5) 5 =A 
where 9 =}|5. Compared with iterations A and B we have 


WO 4 = 400 (1 — cos gQ) 


b= sete eee 


the error in the first iterate here is less than the error in the third 
iterate of method A, so it clearly pays to give careful consideration to 
the choice of iteration scheme. 


Error estimates. The method of error estimation is illustrated for 
the iteration in A, since the evaluation of the limits is by far the simplest 
in this case. We adopt the method 1. of § 5.3 in Ch. I, which is directly 
applicable; in particular, we introduce the norm defined in (5.27) of 
Cheese, 


=—s * * i 
“ll = uppeptnit Of 
where W(x) is non-negative for ~tSxS4. We apply the method 


to the pair of the successive iterates y,(%), Vo(%), and show how great 
the effect of a suitable choice for the norm is. 

The error estimate derived by using a non-negative eigenfunction : 
for W as defined in Ch. 1 (5.31) is very easily found with a negligible 
amount of calculation since the GREEN’s function is not involved ex- 
plicitly; the limits so obtained are, however, rather wide. For 


2’ +Aze=0, 2(41)—0 
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we have the non-negative eigenfunction z =cos > x and the correspond- 
ing eigenvalue is A,= a . With =14 + x, |)|max= 2, the formula (5.33) 
of Ch. I yields the value K = = , which is rather close to 1; this gives 
a correspondingly large value for 


K _ 8 
1 Saas 


We now calculate the “distance” separating y, and y,: 


[v1 — Yel] = upper limit of |”*—** | — 0.00555; 


in —IlSxS1 


cos — * 
2 


(5.16) of Ch. I then yields 
Ive — y|| < 4-28 x 0-005 55 = 0-0237, 
from which we infer the error estimate 
[y2—y|S0-0237cos2 % for |x| S41. 


To obtain a smaller Lipschitz constant and hence a better error 
estimate, we use the GREEN’s function method of Ch. I (5.29). The 
appropriate GREEN’s function for this case was given in Ch. I (3.26). 


hace Ay (bee) for —1isxsé 
: ae 
G(x, &) = 4.49 
NMG 2) pee. sea 
I Pes 


Choosing W(x) =1, i.e. using the norm All = max «If, and with 
N(x) =1-+ 27, we have 


ee ee ee 
(7 — 6x? — x‘) - 


Hoesen a [O00 +8) dE = max i 


This value of AK is much better than the value 8/n? obtained above; 
it gives , > as f = 1-4 and in fact yields narrower error limits for y, 


at the point x =O than those obtained above for y,. With 


221 
ya —_ Vo|| = oie la = Vo| = aie FY 0-002 74 


(5.16) of Ch. I now gives the limits for y, as 


221 


lve — = Se gu 0 00384. 
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The estimate using the GREEN’s function is better still if anon-constant 
function is chosen for W, in this case a polynomial, say, for convenience 
in integration; a suitable choice here is W =1—x?. We then have to 
evaluate the integral: 


f G2) (+2) (1—&) dé = = (14 — 152? + 24) 


a (14 — #?) (14 — x? — x4) 


30 
Substituting in (5.29) of Ch. I, we obtain 


K =max 44 — x2 — x4 = 7 
|z}S1 30 75,’ 


and hence the favourable value 
KO _7 
en 


11 


aEaG we have the error estimate 


Finally, with || y,— yal] = 


id) 9 
A similar calculation with W=1—}.2? (which gives K = {}) leads 
to the estimate 
lve — y| S 0-003 25 (1 — $4). 


At x =0 this estimate exceeds the actual error 0:00271 by less than 20%. 

By using a more general definition of distance (cf. the paper by 
J. SCHRODER in the references given in Ch. I, §5.2) we can obtain limits 
as close as | y, — y| 0-003 04 (1 — x”) without going beyond polynomials 
of the second degree for W. 

II. Non-linear oscillations. It is required to calculate a periodic 
solution of 

—y"— by —y? =scosx, 
7 (4.50) 
y (0) — y (27) = y'(0) — y’(2x) =0 

(forced oscillations of a system with a non-linear restoring force). The 
problem lies sufficiently near to the linear problem obtained by neg- 
lecting the y? term for the iteration defined by 
—Yr+1— 641 =Vi+Bcosx, 4,4, with period 2% (k =0,1,...) 


to converge satisfactorily and allow an error estimate to be made. 
The solution 
Vo(x) = — 0-3 cos x 
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of the linear problem is an obvious choice for the starting function. 
A short calculation then yields 


¥y(x) = 3 (1 + 40 cos x + 3. cos 2x), 


805-5 + 32240 cos x + 
+ 2418 cos 2 x — 240 cos 3 % — 2-7cos 4x), 
5-5 + 240 cos x + 
+ 18 cos 2% — 240 cos 3% — 2-7 cos 4x), 


Ye(x) = us — ( 


M(x) — Yo (x) = ren aoe | 


ly, (*) — ye(x)| S$ —"— 380 = 0-003 56. 


aaa 
For the error estimate we use the basic formula (5.29) of Ch. I with 
W =1; the appropriate GREEN’s function is given by (3.28) of Ch. I. 
With n=|/6 we have 
22 


2nsinn||G(s 8] 45— 2 fleonal ae—2 > sin (Vom) + 4 


= 2542-0) (oy Is 
6 : 


then from (5.25), (5.29) of Ch. I 


2-0361 
i [ésin (Ven) = 0-8418N. 
We now need a value for N, the Lipschitz constant for the function 
y?+ 3cosx. Clearly an upper bound for |2y| will suffice, and if we 
assume that |y|<0-4, i.e. we try to find a solution in the subspace F 
of all continuous functions y(x) of period 2% whose members satisfy 
|y(x)|<0-4, then we can use the value 


N= | 75 ee = 0:8; 
this gives 


K =08418X0-8 = 0-673, -*~_- = 2.06. 


K 
The “‘sphere’”’ 2' defined by 
ly a Yo| <S 0-003 56 X 2:06 = 0-00735 


lies entirely in F, and hence there is a solution in this subspace, namely 


the function towards which the sequence yp, y,, Y2,.-. 1S Converging. 
Incidently this shows that there are no other periodic solutions of (4.50) 
with |y|<0-4. 


The fact that y lies in the sphere ¥' gives us a smaller upper bound 


for |¥| max: 
ly] S|]y1| + ]¥1— v2] + 0-00735 S 0-3409. 
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We can now repeat the above calculation with more refined values: 
N = 2|y|max = 0-6818, K =0-8418 x0-6818 =0-585, 


K 
ae = 1352. 


Thus we obtain the better error estimate 
|v — ¥_| < 0-003 56 X 1-352 = 0-004 82. 


This in turn gives a still smaller upper bound for | y|,,.., and the process 
can be repeated; however, little is gained thereby, for with K =0-570 
we obtain |y — y,| <0-004 72. 


4.9. Monotonic boundary-value problems for second-order differential 
equations 


Consider the boundary-value problems with the differential equation 


L[y] = — [p(x) 9’(x)]’ = — F(x, 9), 


where #(x) is positive and possesses a continuous derivative in the 
interval a<x*x<b, and with the boundary conditions 


(i) Oly]=y(a)=y, Uy] =y(b)=%, 
or 


Gi U,[y] = y'(a) —ey(a) =y,, 
) 


U[y] = 9'(6) + dy(b) =, 


with c=0, d=o. It will be shown that these problems are monotonic 
when F(x, y) satisfies certain conditions. 

Such problems were considered generally in Ch. I, § 5.6, where it 
was shown that they were of monotonic type if 


Lle] +eA(x)20 with A(a)ajo and Ue) —=0 gae—42) (G54) 


implied that ¢=0. We now show by indirect proof that this is true of 
the above problems, excluding only the case with 4(x)=0, c=d=0. 
Suppose that the continuous function ¢ has a negative minimum value 
which it assumes at the point «= &. 

1. If € is an interior point of the open interval (a, 6), then p(é) e’(€) =0. 
Since « is continuous, there is an interval (a, B) with aSa<E<fPxdb 
in which ¢<0 and hence (fe’)’<0 from (4.51). Uhis implies that e’ 0 
for a<*x<é and e’<0 for Sx <P; hence « is constant in (a, B), for 
otherwise, since « = is a minimum, there would exist @ with ¢(0) > «(é), 
E<o<f and hence also 6 with é'(0)>0, &< 6S. It follows that ¢ 
must be constant in (a, 6) also. In case (i) we therefore have ¢=0, 
which contradicts the assumption of a negative minimum value. In case 
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(ii) we have ce(a) =de(b) =0 since e'(a) =e'(b) =0; if c and d are not 
both zero, then again e=0; if c=d=0, then A =0 (since we are ex- 
cluding the case c=d=0, A(x)=0), so that there exists o ina<o<b 
with A(o) > 0, and since e’=0 and e<0, (4.51) is contradicted at x =o. 
Consequently & cannot be a point of the open interval (a, b). 

2. The alternative, that € is a boundary point, say =a, can be 
ruled out immediately in case (i), for it requires that e(a)<0. In case (ii) 
this implies that e’(a) <0; but, since &=aisa minimum, we must also 
have e’(a)=0; hence e’(a2) =0, and we can use the same arguments to 
obtain a contradiction as in 1. but with x =a taking over the role 
played there by x=&. Therefore ¢ cannot be negative in <a, b). 

This result may be stated as follows: 


The boundary-value problem 


~ (p(x) w(x) + Flex, w) =0 (4.52) 


with the boundary conditions 


(i) u(a)=u,, u(b) =u, (4.53) 

Or 

Gi) ( u'(a) —cu(a) =y, (4.54) 
u'(b) +du(b) =z, 


where p(x) is positive and possesses a continuous derivative in (a, b), 

Ug, Uy, Var Vy are given constants and c20, dO, 1s of monotonic type 

in a domain H of the (x, u) space [defined oe @Sxb, uy(x)Susu,(x), 

say ] when — exists in H and in case (i) 5 20 and in case (ii) either 
Ou 


6 or oO and c®?+d*>0. 


Under these circumstances, if the boundary-value problem possesses a 
solution y(x) in H and we have two functions y, and y, which satisfy the 
boundary conditions and ave such that Ty,SOST yp, then we know that 


V(x) Sy (x) S yo (%) 
Example. The problem 
yen, yay (1) = 
is of monotonic type in the domain H defined by 0S %S1, 0 Via - 


Suppose that the existence of a solution in H has been established, say 
by considering the initial-value problem 


Ty=—y"+6xy?=0; y(0)=1, y'(0) =a 


with variable o. For y we can make the approximation 


5 
w=1+ Dd) a,(%—*’), 
v=3 
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which satisfies the boundary conditions for arbitrary a,; the term with 
vy =2 is omitted since y’’(0)=0; more terms can be added as desired, 
of course. The functions 

W, = 1 — (x — x) 


Wy = 1 — 0-43 (x — x4) 
give Tw,S0, Tw,=0, respectively, and hence w,S yz; these limits 


may easily be improved by using more accurate expressions for w. 


§5. RITZ’s method for second-order 
boundary-value problems 

For many boundary-value problems of even order it is possible to specify an 
integral expression J[g] which can be formed for all functions @ of a certain class 
and which has a minimum value for just that function y which solves the boundary- 
value problem. Consequently solution of the boundary-value problem is equivalent 
to minimizing J[g]. In Ritz’s method? the solution of this variational problem is 
approximated by a linear combination of suitably chosen functions. This method 
shares with the finite-difference method a very favoured position among the 
methods for the approximate solution of boundary-value problems. 


5.1. EULER’s differential equation in the calculus of variations 


The means of formulating the required expression /[q! are furnished 
by the calculus of variations. Consider, for example, the simple varia- 
tional problem of determining in the domain of all functions g¢(.) with 
continuous derivatives in aSwS<6 and prescribed values g(a) =, 
gy (b) =B at the end points (the domain of ‘‘admissible”’ functions) that 
function which minimizes the value of the integral 


Hol =SFn eg )ax, ee cx) 


in which J is a given function possessing continuous derivatives with 
respect to each of its arguments. It may be shown? that if a solution 


1 WaLTER Ritz, born 22 February 1878 in Sion (Switzerland) in the Rhone 
valley, son of the artist Raphacl Ritz, studied in Ztirich, then in Géttingen, where 
in 1902 he obtained his doctor’s degree under Voigt; he then worked in Leyden 
under H. A. Lorentz, in Paris under A. Cotton, in Tiibingen under F. Paschen 
and in 1908 went back to Géttingen, where he died on the 7 July 1909. After a 
poorly healed pleurisy in 1900 his zeal for his scientific work was continually in 
conflict with consideration for his state of health, until eventually his health was 
sacrificed. (Obituary by PIERRE WEIsz in W. Ritz: Gesammelte Werke. Paris 
1911.) — Habilitationsschrift von Ritz iiber eine neue Methode zur Lésung gewisser 
Variationsprobleme der mathematischen Physik. J. Reine Angew. Math. 135, 
H. 1 (1908). — Ann. Phys., Lpz. 28, 737 (1909). 

2 Cf., for example, G. Grtsz: Variationsrechnung, p. 11. Leipzig 1938, or 
R. Courant: Differential and Integral Calculus Vol. IT, p. 495 et seq. London: 
Blackie 1936. 
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y =y(x) which gives the integral a value not greater than that given 
by any other admissible function g(x) exists at all, then y(x) must 
necessarily satisfy the second-order differential equation 


d {oF OF 
dx Gr) zie oe ee 6.2) 
[and also, of course, the boundary conditions y(a)=A, y(b)=B]. This 
is EULER’s equation for the functional (5.1). 


5.2. Derivation of EULER’s conditions 


For the application of Ritz’s method to the solution of boundary- 
value problems we must reverse the procedure of § 5.1 and try to write 
the differential equation of the given boundary-value problem as the 
Euler equation of some variational problem; this will yield the ap- 
propriate expression J{p]. For example, for the second-order linear 
boundary-value problem 


L[y] = — 4 (py') + a(x) ¥ = r(x) (5.3) 
with the boundary conditions 
Ui ly] = %¥(4) +o 9"(a) =n, 
Usly] = Boy (b) + Bi ¥"(b) = ye 
it can be seen immediately that with 


F=py? +qp*— 279 (5.5) 
the Euler equation (5.2) is identical with the given differential equation 
(5.3). The boundary conditions here are rather more general than in 
§5.1 and J[y] must be modified slightly (by the addition of certain 
“boundary” terms), otherwise a solution of the variational problem with 
the new domain of admissible functions satisfying the new boundary 
conditions (assuming not both of «, 6 are zero) will not exist in general; 
this modification does not affect the Euler equation. We demonstrate 
by giving a short derivation of the Euler conditions for the more general 
expression 


(5.4) 


b 
Tigl=S (pe? +¢¢2—2ry) dx +Aggit Boys +2419. +23, Gp, (5-6) 


in which the more compact notation gy, has been used for @(a), etc. 

At first we restrict the domain of the admissible functions to those 
functions y with continuous second derivatives which satisfy the 
boundary conditions (5.4); we shall see later that this domain can 
sometimes be enlarged to include functions satisfying fewer boundary 
conditions, or even none at all. 
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Since we do not here go into the question of the existence of a 
minimum of J[] with respect to the given domain of admissible func- 
tions, we will assume that there is a smallest value of / and that there 
is a function Y among the admissible functions g for which J attains 
this value, i.e. 


JY] SJl¢l. (5.7) 


As yet, this function Y has nothing to do with the boundary-value 
problem (5.3), (5.4). 

If 7 is a function with continuous second derivatives which satisfies 
the homogeneous boundary conditions 


a (5.8) 
Bons + Bins = 0 


corresponding to the inhomogeneous conditions (5.4), then the function 
y = Y+en, where ¢ is an arbitrary constant, satisfies the inhomogeneous 
conditions (5.4) and is an admissible function; it therefore satisfies the 
relation (5.7). If we allow ¢ to run through a range of positive and 
negative values, J/[g] defines a function ®(e) of the parameter e which 
possesses a continuous derivative with respect to ¢ and which attains 
a minimum value, namely the smallest value of J/[g_, at e=0. Hence 
the derivative with respect to « must vanish at this point: 
no) — | 2/ le (e)] — [4J[¥ +en) 

aa) =| de liao a de . |,u0= o aa 
[dJ is often written for the expression ¢@'(0) and is called the “‘first 
variation” of J.] 

Substituting » = Y + e7 in (5.6), we obtain 


. Oe) = J(Y + er] 
= f{p(Y’+en')P+9q(¥ + en)? —2r(¥ +en)}dx+4g(¥,ten)? $--, 


and hence 
b 


2 P'(0) =f (PY'n' +g ¥n — rn) dx +AgYana + BoYsm + Ain, +B, 1p 


The integral of the first term in the integrand can be transformed by 
integration by parts: 
b b 


SPY'y' dx =,¥) mm — paYana— f (PY ndx. (5.10) 
The equation ©’(0) =0 then reads 


b 
Sn[—@¥')'+q¥—r]dx+n,W.+mW =0, (5.14) 
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where 
Wa=Ay¥,t+4i—paYe, We=Bo¥,+Bi+p,¥y. (5.12) 
Now equation (5.11) is to hold for any function 7 (x) which possesses 
a continuous second derivative and satisfies the boundary conditions 
(5.8). This is possible only if the factor multiplying 7 in the integrand 
vanishes identically, for otherwise we can always construct a function 
7” =7** satisfying the above conditions but for which (5.14) does not 
hold: let 7 =7* be a function satisfying the above conditions and for 
which (5.11) does hold, and let xy be a point in (a, 5) where the factor 
is positive, say; by continuity it must be positive also for |x — x)| <6 
with 6 >0, and we put 


a, for |x—x | <6 


n* otherwise. 


(5.13) 


Consequently we must have 
(—pY’)'+qY—7=0. (5.14) 
This differential equation, known as the Euler equation of the variatio- 
nal problem corresponding to (5.4), (5.6), therefore furnishes a necessary 


condition to be satisfied by the solution Y(x) of that problem. 
From (5.11) and (5.14) it follows that another necessary condition is 


naW, +, W,=0. (5.15) 
For further discussion we distinguish three cases: 

1. Case a, + 0, B, + 0. Here, given any values 7,, 7, we can calculate 
na, 7 from (5.8). From all functions 7 with continuous second deriva- 
tives and any given boundary values 7,, 7%, we can select one with the 
boundary derivative values 7), 4, calculated from (5.8); this function will 
then satisfy the homogeneous boundary conditions. Thus for any given 
Na, there is a function 7 with the boundary values 7,,7, and satis- 
fying all the conditions of admission. Now (5.15) can be valid for all 
NaN» only if 

a ites O- 
These equations represent two boundary conditions [see (5.12)] which 


Y must necessarily satisfy. 
In order that the solution of the variational problem of minimizing 


(5.6) shall also solve the boundary-value problem (5.3), (5.4), we have 
only to put 

_ a = Bo ih, = 72 AC 

Ay = ol, bi Ay ot, Par Bo B, Po» 1 B, Pv» (5.16) 


for this ensures that the boundary conditions on Y are identical with 
the conditions (5.4) [we have already arranged that the differential 
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equations (5.3) and (5.14) are identical]; #,, #, are here assumed to be 
non-zero, for otherwise the points a, b, respectively, would be singular 
points of the differential equation. 

Since we have made W, = W,=0 by using the values determined from 
(5.16), we have 7,W,+-7,W,=0 for any function 7 with a continuous 
second derivative; thus (and this is an important new aspect) the 
boundary conditions can be suppressed and the solution in the so 
widened domain of admissible functions will satisfy the boundary con- 
ditions automatically. In this case (a, + 0, B, + 0) the boundary conditions 
(5.4) are ‘‘suppressible” according to the definition in § 1.2 of Ch. I; the 
sense in which this type of boundary condition is suppressible is now 
explained. 


2. Case a,=8,=0, a) + 0, 8B) 0. Here our domain of admissible 
functions is restricted to those with the fixed values 
pase — Va 
I sc A lage (5.47) 
at the end points, and from (5.8) we now have 7,=7,=0 for all the 
functions 7. Consequently the expression 7, W,+-7, Wj, vanishes however 
W, and W, are constituted and we may therefore choose Ay, By, A,, B, 
as we please. Thus no ‘‘boundary terms’ are needed in this case, for 
we may take all these constants to be zero and use just the integral 
term in J[g]. We cannot, however, extend the domain of admissible 
functions as in the previous case, and hence the boundary conditions are 
essential. These boundary conditions are ‘‘essential’’ according to the 
definition in § 1.2 of Ch. I; and that terminology also is now explained. 


3. Case in which just one of a,, 8B, is zero. We can combine 
what has been said for the two previous cases; for example, if «,=0, 
f,=-0, we obtain the necessary conditions 

%=0, W=0. 

We summarize these results in the following 


Theorem. The second-order linear boundary-value problem 


— (P(x) y')' +(x) y =7(x), where p(a)+0, p(d) +0, 
& y(a) + a4, y"(a) = 71, (5.18) 
Boy (b) + Br y'(b) = ye, 
including the boundary conditions, may be written as the necessary con- 
ditions to be satisfied by the solution of a variational problem J/igh= 


minimum. In the case «+0, B+ 0, 
b 


Jig] =JS (y'?+¢9°—2rg)dx+R,+R,, (5.19) 


a 
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R= 28) (— ay? (a) + 2y:p(a)), Ry= ee (Bog? (b) — 272.@(b)), (5.20) 


and no boundary conditions need be imposed on the admissible functions y. 
In the case %;=0 we may put R,=0, but we must restrict the admissible 
functions by demanding that they satisfy the “essential” boundary con- 
dition a%@p~(a)=y,. Similarly, when B,=0, we may omit the term R, but 
must insist on the boundary condition Byy(b) =y,. This theorem does not, 
however, answer the question whether the function y(x) is actually a solution 
of the variational problem su formulated or indeed whether J[p] possesses 
a minimum value at all}, 


5.3. The Ritz approximation? 

Having formulated the variational problem (5.19), (5.20) correspond- 
ing to the given boundary-value problem (5.18), we now use Ritz’s 
method for its approximate solution. This consists in the reduction of 
the problem to an ordinary minimum problem by substituting a linear 
combination of suitable functions for g(x), say 


(3) = vols) +3 a,2,(2), (6.21) 


so that J[w] becomes an ordinary function of the unknown coefficients 
of the combination. If we had an “essential’’ boundary condition at 
x =4, say, i.e. ayy(a) =y,, %,=0, then we would choose v(x) to satisfy 
this boundary conditicn and the v,(x) to satisfy the corresponding 
homogeneous condition v,(a)=0; this ensures that %y(a@) =y, for all 
values of the a,. On the other hand, if all the boundary conditions 
were ‘‘suppressible’, we could omit vy and choose the »v, regardless of 
any boundary conditions, but we would have to take into account 
the boundary terms R, and R, as defined in (5.20). 

On account of the linearity of the expression assumed for @, the equa- 
tions for determining the a, so as to minimize J[@| are also linear. We have 


b 
1 as[p] _ fap 7 
2 0a, _ v, +9pv,—72,) ax + aoe 


$+ PEO) (— agp (a) +75) +205 (Boo (0) — 72) =0 


u Sie) Exercise 6 of § 8.11. 

2 Error estimates for Ritz’s method can be found in Nicoras Kry.orF: Les 
méthodes de solution approchée des problémes de la physique mathématique. 
Mémorial. Sci. Math., Paris 49 (1931). 

Of the numerous shorter papers by KrYLoFF on error estimates of this kind 
we mention without giving their titles just a few published in the C. R. Acad. 
Sci., Paris 180, 1316—1318 (1925); 181, 86—88 (1925); 183, 476—479 (1926); 
186, 298—300, 422—425 (1928). 
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If the v, possess continuous second derivatives, integration by parts 
yields 


yf —rnd b (a) v, (a) us ee 
fi Llp] — ax — ee [e] —y3 ae 


+e {U,[p] — yo} =0 (» =1,2,...,)), 


in which the notation of (5.3), (5.4) has been used. Written in full with 
the expression (5.21) inserted for m the equations for the a, read 


Say foe folae — Alea iis AO 2 cx 
k=1 Pa 


ig b 


=— J v,{L [v9] — r}dx + PO) (y [og] yy} | (5-24) 


P(d) v, (6 
— 20 Ulva — a} (= 4,2, ---1). 

When we have only “essential’’ boundary conditions, the boundary 
terms in (5.23) disappear and we are left with equations identical with 
GALERKIN’S equations (see Ch. I, § 4.3). 


Note 1. The differential equation (5.3), which is of self-adjcint form, is a special 
case of the general second-order linear equation 


Livl=fey + hy’ + foy =1(z). (5:25) 


However, when /,(%)=+ 0 [a zero of f,(*) is a singular point of the differential 
equation], the general equation (5.25) may be transformed into the special form 
(5.3); thus if we multiply by 


we obtain 
(f209')’ + foov=re. (5.26) 


The considerations of this section are therefore also applicable to every non- 
singular linear differential equation of the second order. 


Note 2. In principle, any second-order differential equation (including non- 
linear equations) may be written as the Euler equation of some variational problem!. 
In practice the derivation of the appropriate expression Jig] often occasions 
considerable difficulty; in general it requires the solution of a partial differential 
equation. 


Note 3. The Ritz method can also be combined with other approximate 
methods; for example, one can demand that the approximation function (5.21) 
satisfies the differential equation exactly at ¢(<) points (combination with the 
collocation method); this immediately eliminates g parameters and the Ritz 
calculation with p—q parameters is correspondingly simpler, while the accuracy 


1 Botza, O.: Vorlesungen iiber Variationsrechnung. Leipzig 1909. Reprinted 
1949, 705 + 10 pp. 
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of the approximation so obtained, as shown by examples, can be just as good as 
that of the pure Ritz calculation with p parameters provided that the additional q 
conditions are suitably chosen}. 


5.4. Examples of the application of RITZ’s method to boundary-value 
problems of the second order 


Example I. A linear inhomogeneous boundary-value problem. 
From (5.19) the variational problem corresponding to the strut problem 
of § 1.2 (Example I) 


y+ A+e)y+1=0, y(t1)=0 


reads i 


Jig] = i (y'2— (4 + x*) g? — 29) dx =min., 
where g must satisfy the “‘essential’’ boundary conditions w(+1) =0. 
The simplest form we can assume for g is a polynomial expression 
satisfying the boundary conditions and exploiting the symmetry of the 
solution; thus we write 


b p 
Was rs a, v, (x) ad » a, (4 ag x?”) : 
y=1 v=1 
Such an expression with two terms (f= 2): 
yg =a(i—x*)+0(1—+4) with g’=—2ax— 4b% 
(in which we have used a, b instead of a,, a.) yields 


Ricans Be a— <b. (5.27) 


{ LL 
pee gg gg 120! tea 3 


105 


A simple yet significant check can be made on this calculation by 
putting a=b=A, so that p=A(2— x? — x4), and calculating J again 
for this function. We should get the same result, namely 


by putting a=) =A in (5.27). We now calculate a and 6 from 


a ee 
8 da 105 45 3 
1 aJiy] _ 20 (2488 2 9 
‘sg one as” fe 3465 5 : 
obtaining 
4200 231 ay 
= =(0- = — “"_ = — 0:05 433. 
a= 4252 0 98777, b 4252 5 a3 


1 See, for example, TH. Péscuit: Uber eine mdgliche Verbesserung der Ritz- 
schen Methode. Ing.-Arch. 23, 365—372 (1955). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 14 
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The second gti by this method is therefore 


Yq = —— (3969 — 4200 x? + 231 x4); 


in particular we have 


y2(0) = 232 = 0.933.443. 


42 er 


If more accurate values are required, we can use a three-term expression: 


y= a(i — #*) + b(1 — #4) + (1 — #4). 


awe 
1244 93 19846 
aie 2 les b b2 ees Se 
x Jipl= one 45 tests | ga 
25043. 1 2 3 
c a b— C*, 
143 X 315 3 5 7 


which we can check similarly by putting a=b=c=A; with p= A(3 — x?— 24— x) 
we obtain 
i 3764 42 122 


g | = 4287 105 he 
The linear equations 

1 aJlp) _ 19 10 93 1 
Gar sano o BF <—° a 
1 alg] 10 1244 19846 { 

= —_— b ———— EE CO = 
16 0b 45° * 41x 315 “ms 
1 oOj{g] 93 19846 25 943 3 
psa. = b eee 
16 dc 385° 443x315 143x315°. 14°" 


8151a+ 10010b + 10881 ¢ — 7507°5=0, 
10010@ + 161726 + 19846¢ —9009 =0O, 
108814 + 198466 + 25943 ¢ — 9652°5 =0, 
have the solution 
a= 0:9664778 , 
b= —0-004 73781, 
c = —0-029669 58. 


These values define the third approximation g=¥4,, which yields in particular 
y3(0) =a+6+ c¢=0-9320704. 


II. An eigenvalue problem. Corresponding to the eigenvalue 
problem 


Ut +ayyT =A ex)y, 9 (Gia) = 0; 


associated with the longitudinal vibrations of a rod (Example IIT, § 1.2) 
we have from (5.19) the formal variational problem 


’ 


J(¢] ma (1 + 2)" +11 + 2)gr de Satie; G1) —0. 
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Here 4 is formally treated as a constant parameter (justification of 
this procedure is considered in §§ 8.7 and 8.8). The admissible functions 
y need satisfy only the “essential’’ boundary condition (1) =0, but to 
obtain better results we choose an expression for g which also satisfies 
the “suppressible’”’ boundary condition y’(0) =0 


gy =a(i — x*) + 0(1 — x8). 
The boundary terms which should be added to the integral in J[q] are 


zero in this case. With A as the corresponding approximate value for A 
we have 


210” 280 


Hg|=Zatt2- 2% ad4+ Boe A(z at 42-28 ap + 2 oe), 
Repeating the calculation with —a=b=1, ie. p =x? — x3, as a check, 


we obtain 


which is also the value obtained by putting —a=b =1 in J[q]. 
The equations 


1 gb na(h— ah) 441% 428) <0 


3 10 10 210 
eye (27. 4 103 (3 - ae) = 
2 ab a(t ss saa ce a 280 3 


have a non-trivial solution if and only if the determinant of their 
coefficients vanishes: 


ai ee 4t A 193 
3 10 10 210 =. 
ee eo ae 
140 A 210 10 280 


This yields the approximations 
- | 3218524, 
25334 
for the first two eigenvalues. 


By suppressing the second row and column of the above determinant 
we obtain for comparison the “‘first approximation’’ to the smallest 
eigenvalue; thus the single-term expression p =a(1— x?) yields 


que A f == (OF so that A= . FY 3-333. 


14* 
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Approximations for the corresponding eigenfunctions can be found 
by solving the homogeneous equations with the appropriate value of A 
(Fig. I1I/12); for example, with 
A,=3-218 ... we obtain 


b » —0-40a 


gp w a(0-6 — x? +4 0-423). 


Fig. III/12, Approximate eigenfunctions 


III. A non-linear boundary-value problem. For the Example II of § 1.2 


the corresponding variational problem according to (5.1), (5.2) is 


1 
Jig] =f (yp? + ¢*)d*=extremum, (0)=4, (1) =1. 
0 


Fig. I11/13. Solution of the non-linear equations 


As in (5.21), we assume a form 
p=4—3%*+a,(% — x) + a, (x — 23) 
which satisfies the boundary conditions for arbitrary a,,a,. Then from 
1 


LP eae , Nige 
on | [29’(1 — 2%) + 3q2 (x ~ x8)]dx =0, 


0 
1 
4 
ue = f [2p’(1 — 3%") + 3m? (4 — x°)] dx =0 
Ob 
0 


we obtain the two non-linear equations 


1407 + 490a, + 7264, + 9a? + 27a,a,+ oa} =0, 


2 
1302 + 4844, + 750a,+ 9a} + SF a,a,+ 21a% = 0. 
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By linear combination of these equations two new equations can be produced which 
do not contain terms in aj and aj, respectively, and which can therefore be easily 
solved for a, in terms of a, and for a, in terms of a,, respectively: 


_= —105 + 24a,+ fai ae 2856 + 3684,+ $a? | 
. 6 — ta, > ° are 129 — *a, ; 
this facilitates the determination of a, and a,, see Fig. III/13. Table III/12 gives 
the values obtained for a,, a, and compares specimen values of the solution with 
those obtained by means of a single-term expression (without the term in a,). 


Table HI/12. Approximate solution of a non-linear problem by Ritz’s method 


Single-term approximation Two-term approximation 


The everywhere positive | The other The everywhere positive The other 
solution solution 
9a,=—245+ 47 362 a= —7-07004 @,= — 32:20 


a,= —3-0413 a,== 2:72044 a= —12-60 


4 | 2-6798 (error +4:7%) | — 6:38 | 2-56197 (error +0-:08%) | — 5-75 
4 1:7997 (eeror —2-11%) | — 10:35 1:7627 (error —0:86%) — 10°28 
a 1-4798 (error —9-7%) | — 7°88 | 1:31701 (error +0-84%) | — 8-43 


§6. RITZ’s method for boundary-value problems 
of higher order 


We now turn to problems in which higher order derivatives appear; we derive 
the Euler equations generally, including non-linear cases, but we can now be brief. 


6.1. Derivation of higher order Euler equations 


Consider the variational problem 


THT HS Fe 9. Go 9) dx +4 (pla), 92), 9) +1 (6,4 
; + B(p(b), y’(b),.-., pe (b)) = minimum 


with respect to the domain of admissible functions g(x) which possess 
continuous derivatives of order 2m and satisfy certain prescribed linear 
(and linearly independent) boundary conditions 


Ulgl=ry. (4 =1,2,.--,%) (6.2) 


at the points a and b; these boundary conditions may not contain 
derivatives of order higher than m—1. F is a given continuous function 
OS a | gin) with continuous partial derivatives of up to the 
(m +1)-th order, and A, B are given continuous functions of the bounda- 
ry values of y, 9’, p”’,..., amas with continuous first partial derivatives. 
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We assume that the minimum value of J exists and that there is a 
function y(x) among the admissible functions g(x) for which J takes 
this minimum value: 


Jiy] = J{¢]. (6.3) 


Then the one-parameter family of admissible functions defined by 
g(x) =y(x) +en(x), where 4(x) is any function possessing a continuous 
derivative of order 2m and satisfying the homogeneous boundary 
conditions 


Uln]=0 (u=1,2,...,4), (6.4) 


must also satisfy the inequality (6.3). For this family of functions J |] 
is a function ®(e) of the parameter ¢; it can have a minimum at ¢«=0 
only if the derivative ®’(0) vanishes. 

We now evaluate ©’(0): 


@'(0) =E | frerteny ‘+ en',..., 9+ en™) dx + 
: +A(x% +89, ..., 9 9+ en M+ 
+B(yten,..., y+ en), | (6.5) 


=0 
ay, (Fyn + Fyn! + +++ + Ey) dx + Agn(a) +--+ 
* + Agra) + By (8) + +++ + Bom—ny'™—(0), 
where the subscripts denote partial derivatives, for example, 
OF 
Fw = rr) . 


The integrals of the individual terms of the integrand can be repeatedly 
transformed by integration by parts until the factor » appears in place 
of 7; thus we have 


b b 
’ d 
fin ax =[nFyl,— faz Fy dx 
: (6.6) 
tere ’ d a 
[Fon ax = In ee) Fy) + fa aes Fond % 


a 


and so on. With all the terms transformed the condition ®’(0) =0 
becomes 


A a q™ 
fn 3 eee pit (=i) paFmjdx+S=0, (67) 
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where S is the boundary expression defined by 
S= nF: +(0'F, ye ie 


i ”) Fem — 1" S ae yi ae 


ig (= aa eee ret =e A,n(a Neo 


F Aging (a) + Bon (b) + +++ + Bom—vg(6). 


Just as in § 5.2, we infer from the arbitrariness of 7 that the bracketed 
factor of the integrand must vanish [we have only to put 


(be — X%)— ree — Xp ah 7) aaa 


(6.8) 


in place of the third power used in (5.13)]; this a. the Euler equation 
@ 


ax 


ag pee Se 


I ae (at lm = (6.9) 


which again represents a necessary condition to be satisfied by the 
solution of the variational problem. From (6.7) the boundary expression 
S must vanish also. 

We now assume that the given functions A, B appearing in (6.1) are 
quadratic functions of and its derivatives; then the expression S is 
linear in the boundary values of y and its derivatives, and is linear 
and homogeneous in the boundary values of 7 and its derivatives. The 
k equations provided by the homogeneous boundary conditions (6.4) 
can be solved for k of the 2m boundary values 7 (a), 7'(a), ...,4'%-") (a), 
BOND) » 0m nto) in terms of the remaining ones. These 2m —k 
remaining boundary values of derivatives of 7 may be called “‘free 
boundary values’! and will be denoted in any order by 7, 2, ---, Nam—h- 
If we express all boundary values of 7 (and its derivatives) appearing 
in S in terms of the free boundary values, then S can be written in 


the form 


2m—k 
$= > n,W[y] =0, (6.10) 
es | 
where W,[¥y] is a function of the boundary values of y, y’, .... Since the 


n, may be chosen arbitrarily, and since there exists a corresponding 
admissible function, it follows from (6.10) that 


Wiyt=0 (=1,2,....2m—A). (6.14) 


These equations, which must be satisfied by the solution y of the 
variational problem (6.1), (6.2), constitute 2m — # additional boundary 


1 KAMKE, E.: Math. Z. 48, 70 (1942). 
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conditions to be associated with the 2m-th-order differential equation 
(6.9), thus making up the number of boundary conditions to the required 
number 2m. We assert nothing about the existence of a solution of this 
boundary-value problem in the present generality; we also defer dis- 
cussion of the different types of boundary condition (6.2) and (6.11) 
till the next section. 


6.2. Linear boundary-value problems of the fourth order 


For illustration, and also because of their important applications, 
we consider in detail the fourth-order boundary-value problems with 
the self-adjoint differential equation 


Ly] = (g2y"")” — (81 9')’ + Boy =7(x) (6.12) 


and two linearly independent non-contradictory boundary conditions at 
each of the points x =a, x =b. These boundary conditions are divided 
into ‘‘essential’’ and ‘‘suppressible’’ according to the definitions in Ch. I, 
§ 1.2. For fourth-order problems the “‘essential’’ boundary conditions 
are those which contain no second or third derivatives, only the first 
derivative and the function itself. 

As the expression to be minimized in the corresponding variational 
problem we take 


b 
Jig] =S (eo? + e197 + gog?—2rp]dx+R,+R,, (6.13) 


where 


R,=Age+2Bg,% + Coy +2Dy,+2E my (6.14) 
and R, is defined similarly but with 6 replaced by a and with different 
constants in place of A, B,..., FE. The subscript notation here denotes 


argument values, e.g. y,=9(b), gy, =g'(b). The variation g=v + ey 
leads to the necessary condition 
alge Jly + enl)_ | ms 
= J [eay"'n" + e190! + Boy —ryldx+RE+RF=0,[ 
where 
Ry = A yom + Byom + Yom) + C yom + Dry + Ens 
and R* is defined correspondingly. Integration by parts then yields 
O=f Lyi —nds +S, 05, (6.16) 
where ss 
So = 829" — B29" — Boy" + yn + Ayn + Byn! + 
+ Bolger Cy 7 Se ea 
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in which all functions are evaluated at the point x =b (S, reads simi- 
larly). By the usual argument the integrand in (6.16) must vanish; thus 
y must satisfy (6.12) and we must have S,+5S,=0. We now rearrange 
S, and S, in the forms 


S.=1W.+1aW, 
Sy =m W, +0 Wy 
with W,,W,;, W,, W, independent of 7; for instance 
W,= — 29" — gy" + (21+ B)y +Ay+D, | 
Wy =e2y"+Cy+By+E, 
and there are analogous expressions for W,, W,. 


We now consider the prescribed boundary conditions, two at each 
of the points x =a, x=b, and distinguish the following cases: 


(6.47) 


Case I. All the boundary conditions are ‘‘essential’”’, ie. the values 
of y and y’ are prescribed at x =a and x =b. Here there are admissible 
functions such that W,, W,, W,, W, do not vanish, and consequently, for 
S,+5S, to vanish, we must demand that 7,=7,=7,=7=0, ie. that 
the admissible functions satisfy the “‘essential’’ boundary conditions. 

Case II. All boundary conditions are “‘suppressible’’. They may 
therefore be put into the form 


one. 
Vo =Bs¥e + Bs ve +Beo 


with two corresponding conditions at x =a. [We assume that g,(a) +0, 
g,(b) +0, otherwise the differential equation would be singular at the 
end points.] For arbitrary values of 7, 72,1, Wwe can calculate 
Na>Ne >>. from the homogeneous boundary conditions correspond- 
ing to (6.18) and the analogous equations for x =a; with these values 
we can then construct a function 7 such that y+ ey satisfies all the 
boundary conditions and is an admissible function. Consequently we 


must have 


(6.18) 


S,+5,=7,W, +7.Wi + W, +15 W; =0 


for arbitrary values of ,, vi No» Nb and hence W,=W, =W,=W, =0. 
These four conditions must therefore be made equivalent to the 
suppressible boundary conditions at x =a and x=6 [(6.18)]. We see 
immediately that this is not possible in general, for there are six free 
parameters ; in (6.18) and only five disposable constants A, B,C, D, E 
in (6.17). Hence for the equivalence of the boundary conditions to be 
possible at all a relation must exist between the f,, namely 


P+ Be £° + p,— 1% =0; (6.19) 


82d b 
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a similar relation must exist for the boundary conditions at the other 
boundary * =a. 

Case III. Mixed boundary conditions. What has been said in case I 
about essential conditions and in case II about suppressible conditions 
is combined appropriately; here also only a certain class of suppressible 
boundary conditions can be dealt with. 


Summary. The fourth-order linear boundary-value problem 
(2 (x) 9”) — (@1(%) ¥')’ + 80(*) ¥ =7(2), (6.20) 


£2(@) == 0, ge(b) +0, 


with two linearly independent non-contradictory boundary conditions at 
each of the points x =a, x =b, may be identified with the necessary con- 
ditions to be satisfied by the solution y of a variational problem J[ gy] = 
minimum, where 


b 
Jig] =S op"? + 8192+ eog*—2rg)dx+R,+R,, (6.24) 


where 


under the following conditions: 

(1) If all four boundary conditions are essential, then we can put 
R,=R,=0 but we must specifically require that the adnussible functions g 
shall satisfy all the boundary conditions. 

(11) If the boundary conditions at x =a are suppressible and such that 
when written in the form 


a= % Vat te Va + og, 
7 1 Vat aes (6.22) 
Va = 04 Vq + 5 Va + OM 
the relation 
(ay + a5) Soa — bia t+ %e824 = 0 (6.23) 
holds, then we must pui 
Ry = — (4820 + 1820) Pa + 2% S20 Pa Pa + | co 
aE Oe LoaPa — 2 (%68a0 ai Os B20) Pa Bie 203 S2aPa- 


There is no need for q to satisfy any of the boundary condition at x =a. 


(111) Correspondingly, if the boundary conditions at x=b are sup- 
pressible and can be written in the form 

Vo = Bi, + Bays + Bs, [ 

Vp = Bs Vp + Bs Vo + Be 


with 


(Bi + Bs) Gen — 815 + Boge, = 0, (6.26) 
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then we must put 


Ry = (Ba825 + Br 82s) $5 — 281 Gon Po Ps — BoBey Gs" + 6 
+ 2 (Be 8a + Bs82s) % — 2Bs kan %, 
and need not satisfy any boundary conditions at x =b. 


6.3. Example 
For the problem of the elastically mounted rail of § 1.3, ice. 
[(2— 2) 9] + 40y=2—4%,  y'(41) =y""(+1) =0, 


the corresponding variational problem is 
i 
Tle] = S [(2 — x*) p”? + 409? — 2(2 — x*) gp] dx = min. 
=i 


The function g need not satisfy any of the boundary conditions, for 

they are all suppressible. The boundary terms R, and R, turn out to 

be zero in this case since all the «; and f; in (6.22), (6.25) are zero. 
Because of the symmetry, we take 


p p 
Gi 4,47, sothat =) a,(2v — 2) (Q»— 3) x*"-*. 
vai vy=1 
Then for #=3 
3 Jlg] = 40a, + a az + oe a3 + ~ 24, a, + 8X24, a3 + 
592 5 7 So 
+ “35 aaa se 26> 45 20g oa 


(the check with a,=a,—a,=a is used again here). The necessary con- 
ditions for a minimum 


#J _9: 40a,+ * Gt 8a, == 


Oa, 
oJ 40 44 592 7 
aS ‘i - - : ———— 
ae Dee 45 8 as 
7) 592 13064 9 
eee () * (hy ts SS pel Sah eS 
Ba, hia 35 2t 315. 8 35 
yield the values vee 
, = 133303 = 9.045.1958 
40 X 79301 
@=—— 2... = —0-0120175 
79301 
= Se = 0-0023833. 
; 79301 


These give, for example, the approximation 


y (1) =a, + a, + ag = 0-035 561 7. 
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6.4. Comparison of RITZ’s method with the least-squares process 
Consider the boundary-value problem 
y’t+y+x=0, y(0) =y(1) =O. 
RitTz’s method and the least-squares method both replace the boundary- 


value problem by a variational problem; here the respective variational 
problems read 


Ini] =i (p'?— g?—2xg)dx=min., (0) =¢y(1) =0 


and 
al 


Ile] =JS "+p +s)dx—min., (0) =9(1) =0. 
Using the same two-term expression 
p = a, (% — x) + a(x — 23) 
for both of these problems, we have 


3 02 9 76 2 4 4 
—— ———_ (7. pein —9 — 
Jr 10 46 10 @,a,+ 105 ae 6 ay 15 a2, 


Je = sp5 (7072 + 2121 a, a5 + 220003 — 3850, — 784a, + 70). 


Then the equations 0//@a,=0J/0a,=0 yield for Ritz’s method: 
as may, 
oS ee 
and hence the approximate solution 
ee rire ean 3) - 
Ye = se5 (71x — 8x9 — 63.29); 
and for the least squares method 


4448 Peek 
101 x 2437 ’ en Yeh, 2 


i= 


1 


VL = 346137 


(46161 x — 4448 x2 — 41713 x3). 


Table III/13 compares some values of vp and v, with the exact solution 


‘ sin ¥ ; 


sin 1 


The numerical results and the curves in Fig. III/14 show that of the two 
methods Ritz’s reproduces the function y more accurately while least- 
squares gives the more accurate values for y’’. 

Now consider the fourth-order boundary-value problem 


£Y = (x),  y(0) =y"(0) =y() =") =0 
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Table III/15. Comparison of results obtained by Ritz’s method and the least-squares 
method 


Exact 
solution 


y(x) 


Approximate solution 


by Rrtz's method: yz (x) by the least-squares method: yz (x) 


134035 


0-06944 (error —0-45%) >; = 0:06807 (error —2-4%) 


1969 096 
y’(0) ae = 0:19241 (error +2:1%) An Sh = 018754 (error —0-46%) 
y"(1) — Geo = — 036314 (error —1:5%) |-—S2874_ _ _ 9.35701 (error +0-25%) 


for the deflection y of a loaded beam with constant flexural rigidity 
supported by smooth pin-joints a distance / apart. The corresponding 


Ritz variational roblem 4 ; 
. P avon Error in ¥ 
i t iT 
Inlpl=J (e"*— 299) ax ! 
= Min., 
7 (0) = ¢()) =0. 


Since g=y'’, the integral 
can be transformed by two 
integrations by parts to give 


l 


Hele) —J (p’*— 2py™) dx 


0 
i 


= (p"2—29" y")dx 
0 
= min. 


This integral differs only by 
the constant 


i 
fy"*ay =A 
0 


from the integral in 


l ——— least-squares method 
* = maf)? hitz’s method 
Jr lel =JS (p" —y'")2dx 
0 Fig. [11/14. Comparison between Ritz’s method and the 
= min least-squares method 
=e ay: 


which the Ritz method therefore minimizes with J,[g]. The cor- 
responding least-squares variational problem reads 


I 
Jt{y] = f (g'Y — 9)? dx = (pV — y!¥)2dx = min. 


0 
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Thus Ritz’s method minimizes the error integral of the second derivative 
while the least-squares method minimizes the error integral of the 
fourth derivative. Consequently least-squares gives the better ap- 
proximation to the fourth derivative but its values for the function y 
itself are less accurate than the corresponding Ritz values; in fact it 
can happen that they are hopelessly wrong — C. WEBER! gives an 
example in which the approximation to the deflection even has the 
wrong sign throughout. 


§7. Series solutions 
7.1. Series solutions in general 


For many boundary-value problems, especially those with a simple 
analytic formulation, a solution can be obtained in the form of an 
infinite series Fs 

y (4) =D egye( (7.4 
o= 


of given functions y,(x) whose coefficients c, are initially undetermined. 
The success of the method depends principally on the nature of the boundary- 
value problem and on a suitable choice of the system of functions y,. In 
the examples of § 7.3 the assumed series converge well and in some 
cases the series method is actually superior to all other methods; on 
the other hand, there are cases in which the infinite series either con- 
verges only very slowly or does not converge at all. 

A general procedure for obtaining a series solution of a linear or 
non-linear boundary-value problem Ch.I (4.1) with linear boundary 
conditions Ch. I (4.7) is now described. 

Let z be a function satisfying the boundary conditions 


Ul[zj=y, (w=1,2,...,%). (722) 
Then for the y, we choose a system of functions which is complete in 
the interval considered, <a, b> say, (for example, a system of trigo- 
nometrical functions or of spherical harmonics) and whose members 
satisfy the homogeneous boundary conditions 


U,|y.] = 0 = 1,2, 25%; O— tae (7.3) 


The assumed completeness of the system y, permits us to express the 
solution y in the form 


v(x) =2(2) +2 cue) (7.4) 


which satisfies the boundary conditions (7.2) for any c,. These coeffi- 
cients are to be determined so that y satisfies the (linear or non-linear) 


1 WEBER, C.: Z. Angew. Math. Mech. 21, 310—311 (1941). 
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differential equation (1.4) of Ch. I, ice. Peay, )', <a \ee0. Forthis 
we must assume further that the expansion (7.4) may be differentiated 
term by term » times so that it may be substituted in the differential 
equation. If y is the required solution, this should yield F =0; therefore 
the coefficients in the expansion of F in the form (7.1) (this expansion 
also is possible because of the completeness of the y,) must all vanish. 
If the y, were also orthogonal, this would lead directly to the equations 


b 
Nieeae—=0 (9 =1,2,...); (7.5) 


otherwise the y, first have to be orthogonalized. Equations (7.5) written 
out in detail read 


b foe) co foe) 
jE ane + Ce Wg 2+ 2 Cy Ps, BEY cong) yy (2) dx =0 

a o=1 o=1 o=1 
(o =1, 2,...). 


Thus we have an infinite set of equations, non-linear in general, for 
the infinite number of unknowns c,. For numerical calculation the 
series (7.4) is terminated after a finite number of terms (say #); we then 
have a finite set of equations for ¢,,...,¢,: 


(7.6) 


b p p 
SE (x, 2+ 2 cover +12 + couel)) y_ (x) dx =i 
a o=1 o=l1 

(OA 2 ey Py 


For the special case of a linear second-order problem with essential 
boundary conditions these equations are identical with the Ritz-Galerkin 
equations (5.23). 

A series approach! which is occasionally used for problems with one 
or more boundary conditions at infinity makes use of two series, a 
power series at a finite point x =x, and an asymptotic series at + = oo; 
these expressions tor the solution are joined smoothly at a suitable 
intermediate point + =«. 


(7.7) 


7.2. Power series solutions 
We expand all functions appearing in the differential equation in 
powers of x or x —é for suitable € and assume a corresponding power 
series expansion for the solution: 


v(x) = 3 a(x — 6) (7.8) 


1 An example of the application of this technique to a non-linear problem can 
be found in U.T. BOpEwaptT: Die Drehstrémung tuber festem Grunde. Z. Angew. 
Math. Mech. 20, 241—253 (1940). 
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By inserting this series in the differential equation, rearranging in powers 
of x — £ and equating to zero the coefficients of (x — €)* (for k =0,1,2,...), 
we obtain in general an infinite set of equations for the a,. The 
boundary conditions yield » additional equations for the a,. This 
infinite system of equations is solved approximately by retaining only 
a finite number of equations and the same finite number of unknowns 
a,. In many cases a formula for the successive a, is obtained from 
which convergence of the power series can be inferred and the assumption 
that the solution can be expressed in the form (7.8) thereby justified 


(cf. Example I of § 7.3). 


7.3. Examples 


We will show how the series method is carried out in practice by 
means of a few examples. 


I. The form of the coefficients in the differential equation of the 
strut problem 
ye (fea) gril Oo imo 
(Example I of § 1.2) suggests that a power series expansion would be 
convenient here. There are two obvious ways of proceeding. One is to 
put 00 
yaa (7.9) 


in which we include only the even powers of x?” because of symmetry; 
we then express the a, successively in terms of a) by inserting the series 
in the differential equation and equating coefficients to zero; finally 
we determine a, from the boundary condition v(1)=0. The other 
alternative is to put 


y =>, (1— 2%), 
v=1 


which satisfies the boundary conditions already, then determine the 0, 
from the infinite set of linear equations obtained by inserting the series 
in the differential equation and equating the sum of the coefficients of 
like powers of x to zero. Both methods lead to substantially the same 
results, so we will describe only the first. Thus using the series (7.9) 
we have 


(124) y= Da (ert att) ay + (44,1), 


y= D) (2v + 2) (2 +1) a4 2°”, 


v=0 
and substituting in the differential equation we obtain 


1+ a) +2a,+ > [a, +4,_, + (2 + 2) (2» +4) a,,,] ?"=0. 
v=l1 
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By the uniqueness theorem for power series, this implies that the coef- 
ficients of all powers of x must vanish separately; consequently 
4 + a + 2a, = 0, 
(7.10) 
Ga, +4, ere ia —0° (w= 4, 2,3,...). 
From this recursive formula the a,, a), 43,... can be expressed succes- 


sively in terms of dy (see first column of Table III/14). We can also 
use this formula to show that 


|a Ls pt lee for v—14,2,3, +... 


Table III/14. Calculation of the coefficients in a power series solution 


ap p Zue _—— 

@=—F(1+4)=— Fr (1+4) [4] 3¢(—1+ a9) 1 

Og = — hy (ay t+ @) =f, (1 — 4) 2| qr (— 11+ 114) 1 

Og = — gyq (1 +45) = 4) (11 + 1309) 131 Gp (— 319 + 343%) sag = 0°93003 
a,= 4, (— 41 + 1745) 4) gr (— 3581 + 3845 a9) 0-934 339 
= ib 575 — 745.45) 5| ser (— 322405 + 345904 ay) 093207304 
ag = 38; (853 — 157 a9) 6 53; (— 42556607 + 456587754) | 0-93205757 
Oy = yqy (14327 + 1982549) 7 zor (— 42556 528-3 + 45658884a,) | 0-93205362 


For »=1, 2 the validity of this upper bound can be verified from 
Table III/14; for » > 2 it follows by complete induction: if the inequality 
is true for y—1 and », then 


- |a,_, + a,| 1+ |a,| 1 1 
|a.ea] = (2» + 1) (2v + 2) = (2v + 1) (2v + 2) = @v—a * @v—1) a) 
4+ |4o| = . 
= G+) Fa) y= 2,3,--.); 
thus it is also true for» +14, and hence for all ». Since pi = a con- 


verges, the assumed power series converges ually on uniformly 
in the closed interval —1< x1; hence the expansion is justified. 
The boundary condition 
alt 

yields an equation for a). For numerical calculation the series iS 
truncated after some term, say the term in a,; the fourth column of 
Table III/14 gives the sequence of approximations to a, for p=1, 
Brey 7: 


Collatz, Numerical treatment, 3rd edit., 2nd print. 15 
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Error estimation: The error in a, due to truncation of the series 
after the term with »y = can be estimated quite easily in this example. 
We can write 


Pp 
a, =a, + aof,, ND a, B,, 


where the numbers a,,8,, A,, B, are independent of a, (their values 
can be found from columns 14 and 3 of Table ITI/14); then the #-th ap- 
proximation to a, is the quotient — A,/B,, values of which are given 
in the fourth column of the table. To illustrate the procedure we will 
estimate the error in —A,/B,. It can be seen from the table that 


| ar| < [ag], |Br| <|Be|; 


then from (7.10) we obtain successively the upper bounds 


Z|] _ | ol | | Jag] 4 
xe] S Tete = oon |%| = (abn | o| = en 49X20’ 
|e] 4 
so that Jon | = a Pye 


ee) 
1 


{esl ( «+ \agel eal 0? 
Jal se 60 \t ces T 3rxa0 © at a )= “eo 12027. 


Precisely similar considerations yield 
|< | Bel 
>A Sup X 1027. 


4265 4265 1-027 


Since | a¢| ate the error in A, is at most a with 
— A, 213 x 108/12! the relative error is therefore at most 0-35 x10 °. 
7385 1:027 


Similarly the relative error in B, is at most x <0-06 1078, 


60 228 x 108 
and hence the error in ay is at most 0-42 x10 § Thus we have the error 
estimate 
| 4g — 0-9320536| < 4-2 x 107. 
II. For the non-linear problem (Example II, § 1.2) 
y= ey; y(O)=4, y(t)=1 
we expand y(#) as a power series at += 1, say in powers of s=1— #: 
oO 
y(s) =1-+ Dia,s”. 
y=1 
Substitution in the differential equation yields 
2a, + 6ags + 1244s? + 20a,59+ 30agst + 42a,55+ -:- 
= $+ 3a,s + (3a? + 3a,)s*+ (3a, + 3a,a,) 88+ (2a% + 3a,a,4 3a,) s#+ 


= (34,4, =i 34,444 34,) sh fives, 


7.3. Examples 


and comparing coefficients of like powers of + 
we find that 


$=24,, 6a,;=34,, 12a,=$22+ 3a,,. 


By means of these equations we can express 
@y, @,,..- successively in terms of a,, so that 
the series for y becomes 


2 
yatfas+ ty 24 PTS 


2 16 a 


34 5, 441+3 ,, Git+6a,, 
Pare a 


The boundary condition y=4 at s=1 is then 
an equation for a,. If the series is terminated 
at the term in s*, we obtain the quadratic 
equation 

31 


7 


a? 3 
te 
with the solutions 
1:2457 
= 6 . — 
“1 + 525 jisaanen 


If two more terms are retained, we still have 
only a quadratic to solve, namely 


3a? 27 127 
Toe 6 ae + 
from which we obtain the values 
_ See [106776 
“1 ¢+]31= | — 10-068. 


The corresponding approximations for the every- 
where positive solution y(%) for several values 
of x are given in Table III/15 with their percent- 
age errors in brackets. 

The power series for the other (partly nega- 
tive) solution does not appear to converge 
since y (4) ~ — 11 (cf. Example II, § 1.2). 


§8. Some special methods 
for eigenvalue problems 


Eigenvalue problems have already been 
treated several times in this chapter, but by 
methods, which are also applicable to ordinary 
boundary-value problems — actually we used 
several finite-difference methods and Ru171z’s 
method, but other such methods can be used. 
We now describe some methods designed speci- 
fically for eigenvalue problems, giving particular 


Table 111/15. Approximate values obtained by applying a power series method to a non-linear problem (Example IT) 


Approximate values for the 


other solution 


obtained by truncating the power series at the term in 


everywhere positive solution 


(+2:2%) 


2:6209 (+2:4%) 


1:32365 (+1:3%) 


1°8168 


1°3393 (+2:5%) 
14-8502 (+4:1%) 
2:6656 (+4:1%) 


% ) 
% ) 


1:3696 (+ 4:9%) 


1:9120 (+11 
2:7395 (+ 7 


%) 
% ) 


14336 (+ 98%) 


20313 (+14 
2°8633 (+12 


15% 
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(percentages in brackets are the relative errors) 
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prominence to the method of successive approximations or iteration method. In 
§ 8.3 we mention an important bracketing theorem for a special class of eigenvalue 
problems; in many cases this theorem enables one to obtain limits for the first 
eigenvalue to an accuracy sufficient for most applications with very little com- 
putation. 

In the following we make use of a series of results from the theory ofeigenvalue 
problems; for proofs the reader is referred to the literature. 


8.1. Some concepts and results from the theory of eigenvalue problems 
Let the differential equation read 


M[y] =aN[y], (8.4) 


where M[y] and N[y] are linear homogeneous ordinary differential 
expressions [see Ch. I (1.6)] of the form 


Mi) =Sb,(4) 99, (8.2) 
Ny] =S4, (x) y) (8.3) 


with m>n. The ~,(x) and q,(x) are given real functions which will here 
be assumed continuous. With the differential equation we associate 
2m linear homogeneous boundary conditions [cf. Ch. I (1.7)] 


U,[y]=0 (wu =1,2,...,2m). (8.4) 


The differential expressions M[y] and N[y] are often assumed to 
be of the special “‘self-adjoint’’ form 


m 


M{[y] =d (— 4)" TF) 91, 


v= 


NEy] => (—A)' feo (x) 91. 


ye@ 


(8.5) 


The f, and g, are given functions which we assume here to be real and 
to possess continuous derivatives of order v; further we assume that 
LO and g,=- 0. When  =0, the eigenvalue problem, then of the form 


M[y] =480(*) 9, (8.6) 


is called a ‘‘special’” eigenvalue problem; when # >0, it is called a 
“general” eigenvalue problem. 


1 For example, R. Courant and D. HILBERT: Methods of mathematical physics, 
Vol. I, 1st English ed. New York: Interscience Publishers, Inc. 1953. — CoLLatz, 
L.: Eigenwertaufgaben mit technischen Anwendungen. Leipzig 1949. 
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For problems in which the eigenvalue 4 does not appear in the 
boundary conditions we make the following definitions: 

A comparison function is any function other than the zero function 
which satisfies all the boundary conditions and possesses a continuous 
derivative of order 2m. 

An admissible function is any function other than the zero function 
which satisfies the essential boundary conditions (see Ch. I, § 4.2) and 
possesses a continuous derivative of order m. 

The eigenvalue problem (8.1), (8.4) is called self-adjoint when 


b 
Jf (uM[v] —vM[u]) dx =0, 
a (8.7) 
J (uN[v] —vN[u]) dx =0 
for any two comparison functions 1, v. 

The eigenvalue problem (8.1), (8.4) is called full-definite when 


Wanaaiax =o and Wii (8.8) 


for any comparison function w. 

Whether these conditions of self-adjointness (8.7) and full-definiteness 
(8.8) are satisfied in any given case can be readily determined by inte- 
gration by parts!; for example, the eigenvalue problem 


—y"=he*y; y'(0)=0, yt) +y’(1) = 


is shown to be self-adjoint and full-definite, respectively, by the follow- 
ing two simple calculations: 


1 
f (uv — ul v) dx = [uv —vu')G 


; = u(t) v'(4) — v(A) 4'(1) — 4(0) »'(0) + 0(0) w’(0) =0 


for any two comparison functions u, v since 


and 
1 
f(—un"’ —[uu'}) + fultax- = [u(4 (P+ futax>o 
0 


for any comparison function “. This last inequality sign could be re- 
placed by an equality sign only for a function with u’=0 and u(1) =0, 
i.e. for the function ~=0, but the zero function is excluded from the 


domain of comparison functions. 


1 See L. Cortatz: Eigenwertaufgaben, § 4. Leipzig 1949. 
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In eigenvalue theory an important role is played by “RAYLEIGH S$ 
quotient”’ 
b 
fuM{[uldx 
R [uw] — a . (8.9) 
fuN{[u] dx 


For full-definite problems it exists for all comparison functions « and 
is positive. 
A self-adjoint, full-definite eigenvalue problem has the following 


properties: 
It possesses a countably infinite sequence of positive eigenvalues 
0<A,<4,<-:- with corresponding eigenfunctions y,, y.,.... Its first 


eigenfunction y, is the solution of the variational problem of minimizing 
the Rayleigh quotient (8.9) with respect to the domain of comparison 
functions; the corresponding minimum value is the first eigenvalue /,. 
More generally, the (s + 4)-th eigenvalue A,,, is the minimum value of 
the Rayleigh quotient (8.9) with respect to the domain of all comparison 
functions « which are orthogonal to the first s eigenfunctions y,,..., ¥, 
in a “generalized sense’, namely in the sense that they satisfy the 
“generalized orthogonality relations”’ 


b 
jiaNigies 90. (j= 4e2-...,,s). 


When multiple eigenvalues occur, they must be counted according to 
their multiplicity. 


8.2. The iteration method in the general case 


We base the description of the method on the differential equation 
(8.1) with the boundary conditions (8.4). 

In the general case the procedure is as follows: We start with an 
arbitrary function /j(x) and from it determine successively a sequence 
of functions F,, ,... by calculating K as the solution of a certain 
boundary-value problem which depends on #,_,. This boundary-value 
problem is obtained from the eigenvalue problem (8.1), (8.4) by writing 
F,_, in place of y in all terms (in the differential equation and the 
boundary conditions) which are multiplied by 4, writing F, in place of v 
in all the remaining terms, and finally putting A= 1; thus for the eigen- 
value problem 


yVtAy"+y=0; yO) =y"(O) = y(t) = y(t) —Ay"(4) =0 
Fis determined from fF, , as the solution of the boundary-value problem 


FN+F.=— Fea 50) =H (0) =F) =0, Balt) ="Bealt). 
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The absence of 4 from the boundary conditions simplifies the 
description of the procedure: starting from any function F(x) we 


determine successively A, F,,... from the boundary-value problems 
MR = Ni _,|, 
Ui) = NEF] (k =4,2,...). (8.10) 
U,[F,] = 0 
If the ratios of successive terms in the sequence h, F, 5, ... tend 


to a constant (independent of x and k) as k increases, say F,_,/F,—K, 
in which case we say the sequence converges, then one expects the 
functions /, to assume more and more the form of an eigenfunction y, 
with eigenvalue A, = (an eigenfunction is only determined to within 
a constant factor). The quotient M[F,]/N[F,] should provide an ap- 
proximation to A, but as it is still a function of x we use a more suitable 
approximate value A obtained by taking weighted mean values of the 
numerator and denominator as in RAYLEIGH’S quotient (8.9): 


b b 

f[F,M[F,] dx f F,N[F,_,) 4% 
b 6 

fF,N( RJ dx f F,N(F,] dx 
a a 


The integrals appearing here in the numerator and denominator are 
denoted by A 
az, =f N(R) ax, 


b 
Qex-1=JS Fi N[F J dx 


and are called ScHwarz’s constants after H. A. ScHwarz. A is then the 
quotient of two successive Schwarz constants; if we introduce the 


Schwarz quotients . 
Pati = a (k =0,1,2,...), (8.14) 
ak 
A is the Schwarz quotient s5,. 
In order tc say more about A we must make more restrictive assump- 


tions about the eigenvalue problem!. 


8.3. The iteration method for a restricted class of problems 


Here we consider only those eigenvalue problems? (8.1), (8.4), (8.5) 
which are self-adjoint and full-definite and whose boundary conditions 
are independent of the eigenvalue A. 


1 A more general theorem has been established by H. WIELANDT: Das Iterations- 
verfahren bei nicht selbstadjungierten Eigenwertaufgaben. Math. Z. 50, 93—143 
(1944). 

2 Fewer restrictive assumptions are made by E. STiEFEL and H. ZIEGLER: 
Natirliche Eigenwertprobleme. Z. Angew. Math. Phys. 1, 111—138 (1950). 
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We restrict our choice of starting function f(x) slightly by demand- 
ing that it shall be continuous, possess continuous derivatives of order 
up to 2m and satisfy just so many of the boundary conditions (not 
necessarily all) that a) >0 and 

b 

J (RN[u] — uN) dx =0 (8.12) 
for all comparison functions 4. Integration by parts readily establishes 
which boundary conditions should be satisfied in any given case. 

Consider, for example, a special eigenvalue problem with N/[/] = 
2o(x)f: (8.12) is automatically satisfied and also a)>0 since the full- 
definiteness condition implies that g)(x)>0. In this case, therefore, 
Ff, need not satisfy any boundary conditions. 

If K satisfies all the boundary conditions, then (8.12) and a) >0 are 
automatically satisfied for any self-adjoint full-definite problem since 
F, is then a comparison function. Usually Fy will be thus chosen on 
account of the more accurate results which may be expected; nevertheless 
it can sometimes be more convenient for calculation to impose a smaller 
(but sufficient) number of boundary conditions on /. 

For the sequence of functions Fh, F,, F, ... derived from such an Fy 
by the iteration process described in § 8.2 the Schwarz constants can 
be defined generally by 


b 
a,=SEN[R_jdx (0Si<k, k=0,1,2,...). (8.13) 


Their dependence on 7 is only apparent, for using the iterative relation 
of (8.10) and the self-adjoint condition (8.7) we have 


b b b 
a, = f EM[F_isi)d* = f Risa M[F] dx = f Rei N(R) dx 
a a 
= f FN) 4%, 


b 
and consequently the integral f F N[F,_,;|dx depends only on the sum 


of the suffices 1 + (k —1) =k; for example, 
b b - 28 
a=[BN(Rldx=SRN[Kldx=fRN[Rldx. (8.14) 


The full-definite condition (8.8) implies that a,, a), ... are all positive, 
for b 
aa, =f RN[Rldx>0, 

ie (hip) (8.15) 
toy =f RMR] dx>0 


a 
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and since also ay>0, all the Schwarz quotients (8.11) are positive. 
The quotients u,, with even suffices may be written as Rayleigh 
quotients (8.9); for example, 


b b 
SAN[Rldx fRM[Rj\dx 

ba = a — Oo = 4 + = R[F] ? (8.16) 
SRNRldx SRNR] dx 


and generally we have 
‘ yc iop (8.17) 


Under the assumptions of this section it can be shown that 
My 2 a2 Ug 2 ZA. 

It is also possible to prove the following bracketing theorem: 

Theorem: Let the eigenvalue problem (8.1), (8.4), (8.5) be such that 

(i) the conditions of self-adjointness and full-definiteness are satisfied, 

(ii) the eigenvalue A does not appear in the boundary conditions, 

(iil) the smallest eigenvalue A, is simple, 
and as starting function for the tteration (8.10) take any continuous func- 
tion Fy(x) with continuous derivatives of order up to 2n and which satisfies 
so many of the prescribed boundary conditions that (8.12) holds and a> 0. 
If tu, ts the k-th Schwarz quotient (8.11) calculated from the iterates F, via 
the Schwarz constants a, (8.13) and if 1, 1s a lower bound for the second 
eigenvalue such that l,>U,+1, then the first eigenvalue A, lies between the 
limits 

Py, — EE SA Sts (k =1,2,...). (8.18) 


th sa 
PR+1 


8.4. Practical application of the method 


Starting from a chosen function f(x) we have to determine each 
subsequent function F,(x), R(x),... by solving a boundary-value 
problem (8.10). If the given differential equation is of very simple 
form with coefficients given formally by simple expressions, then a 
number of iterates #, can be calculated. But for complicated eigenvalue 
problems the repeated solution of these boundary-value problems pre- 
sents considerable difficulties, and it is therefore important that for the 
restricted class of eigenvalue problems of § 8.3 an accuracy sufficient 
for technical applications is generally achieved by using only /j(x) and 
F, (x). The calculation can be divided into three steps: 

4. Find two functions &, A with the properties: M[K] =N[Fy], 
F, satisfies all the boundary conditions and fy satisfies so many that 
(8.12) holds and a)>0. 
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In many cases two such functions fy, F, can be determined by graph- 
ical integrations (when applying the method graphically, one should 
always integrate and never differentiate) ; however, we shall not go into 
the graphical application any further here?. 

For the special eigenvalue problems, for which N[Fo] = g)/, we can 
choose F, arbitrarily from among the comparison functions and calculate 
F, from g,&=M [A]. & can be expressed as an arbitrary linear combi- 
nation of functions yp; which satisfy all the boundary conditions, and 
the coefficients of the combination will usually be determined so that Fy 
also satisfies the boundary conditions. This often leads to substantially 
better results, for in general the more /, and F, resemble the first eigen- 
function, the more accurate the results turn out to be. 


2. Calculate the Schwarz constants and quotients 


b b 
a= [RN] dx, a,=f{RN[A lax, 
ss (8.19) 
a, a 
ian) Ae es | ee 
We then know that 
fy 2 fg 2 Ay. 


3. Finally we calculate a lower limit for A,. For this we need a 
lower limit 7, for the second eigenvalue A,; it must be greater than wg, 
but as long as this requirement is satisfied it need not be particularly 
close to A,. In many cases such a lower limit /, can be obtained by 
comparison with an eigenvalue problem with constant coefficients (see 
§ 8.5). Then from (8.18) with k =1 we have 


be on (all ae Me < Ay SS as. (8.20) 


For technical applications it is not always essential to have rigorous 
limits and it will often suffice to have a rough guide to the closeness 
of 4. to A, so that we may know how many decimals in svg can be used 
for A,. In such cases one can replace /, in (8.20) by an approximation 
to A, calculated by the Ritz method or the finite-difference method, 
or in fact by any other suitable method. Although this procedure is 
not strictly valid, it can be justified to some extent on the grounds 
that changes in /, have little effect on the lower limit in (8.20) when 
l, is appreciably greater than fly. 


1 See L. CoLttatz: Eigenwertaufgaben, § 13. Leipzig 1949. 
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8.5. An example treated by the iteration method 
For the eigenvalue problem 


—[(t+a)y!=s4i+xy, y'(0) =y(1) =0 
of Example III in § 1.2 the conditions to be satisfied by K and F, are 
—[(1+a)A/=4+2)%, Ko) =H) =0. 


Although Fj need not satisfy any of the boundary conditions, better 
results may be expected if it satisfies at least the essential boundary 
condition /)(1) =0. We therefore take F, to be a polynomial of at least 
the third degree 


Fy = ag + a, % + ay x? + aa x8, 


for we have three conditions to satisfy and a constant factor is indeter- 
minate. The boundary conditions on F, eliminate two of the constants; 
forming /, and putting /j(1) =0 eliminates a third; the fourth is chosen 
conveniently to give 


es. 9 3 — 2(5+4%—9x°) 
3% — $e? aae?, = neers : 


We now calculate the Schwarz constants from (8.19): 


1 
wo fat x) Fo dx = 2561n2 —121 = 56-445 68, 
yi 
mi =f +2 R Rds = = 17:53333, 
x 
a,=f(1+x)Fedx au = 5-4476190. 
: 105 


These values yield the Schwarz quotients 
fis = 2 = 3-219335, fa = GE = 3.248532, 


which constitute upper limits for A,. 

To calculate a lower limit from (8.20) we need a lower limit /, for 
the second eigenvalue. This, as has been said before, may be fairly 
crude and for this example can be obtained by comparison of the given 
problem with a simpler problem possessing an exact solution. If the 
function 1 +x, which occurs on both sides of the differential equation, 
is replaced by its maximum value of 2 on the right-hand side and by 
its minimum value of 1 on the left-hand side, we obtain the constant- 
coefficient eigenvalue problem 


—y"=2h*y, y'(0) =y(1) =0, 
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whose second eigenvalue Aj is given by 
2dg = (¥)*. 


This new eigenvalue problem has the property! that R*® a SX a) for 
all comparison functiens w, where A* w and Row are the Enda 
— of the new and eld problems. respectively. Henee af S 4, for 

=1,2,... and in particular we can use AF as a lower limit fer A,. thus 


we put i, ane 
With this value (8.20) yields 
3-218241 SA, S 3-218532. 


8.6. The enclosure theorem 


The following theerem, which is proved im the theery of exenvalues 
and usually known as the enclosure theerem, is often quite useful om 
numerical work. It is concerned with a certain class of etgenwalue 
problems, the ‘‘single-term” class, for which the operater Vy comsists 
of only one term: 

N[y] = (— )"[en(4) x. 


The differential equation is consequently ot the term 
M[y] = (— 1)"A[g, (4) vy. (8.21) 


We impose the usual conditions ot self-adyemtmess and tull-det- 
niteness and, as in $8.1, assume that the function gli t) has the same 
sign throughout the fundamental wrerwal f#.2). We asswme forthe: 
that the given boundary conditions are such that 

b b 
(— 4)" fulge yy a _ fg ™ v™dx 
Ct 8 
for any two compansen functiens #,¢ amd any tumcbor gos) wath 
continuous denvatives et up te the #-th order (that this comditien ts 
satisfied for any given problem can easily be veritied by mregracien by 
parts). 

The theorem states that if we have a funetien Apt) with contimmeus 
derivatives of order up to 28 and a cemparisen tunetior FL (1) sweh chat 
M(E,] =N(A], cf. (8.10), and if further the function 


, Fes) > 
P(x) = a) ($-22) 


1 Cf. the comparison theorem in L. — Eigenwertaufgaben. SS. Leipsig 


1040; this Geals with the case m whwek the dittetercia: cwpressame A & She seme 


In beth prottems but the extensive fo va WROTS CUT, Cet Cemenderga Reve a 
immediate. 
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is bounded and does not change sign in the interval (a, 6), then at least 
one eigenvalue 4, lies between the maximum and minimum values of 
® in the interval (a, }): 

A, s Ores a (8.23) 


For special cigenvalue problems (n =) the conditions to be satisfied 
by fy and /, can be formulated more simply!. It is sufficient to select 
any comparison function F, and put 


1 
iy ee (8.24) 
Then 
MIF) _ M(E] 
Oey = a) 
WR NURI’ a) 
and we have 
MEM) <3 < (MIA) 2 
ea Jota = 1S bors ea (8.26) 


The function Fy need not satisfy any of the boundary conditions but 
one will usually try to choose F, in such a way that J satisfies as many 
boundary conditions as possible; for by so doing one approximates an 
eigenfunction more closely and there is a better chance of obtaining 
reasonably narrow limits in (8.23). 

The results can be improved, often quite substantially, by the 
introduction of a parameter? g into the assumed expressions for Fy and 
I. This parameter is then chosen so as to minimize the difference 
between the upper and lower limits of (8.23). 


Example. Again we consider the vibration problem of § 1.2 
eer — ees y | =AL+2)¥, 9 (Okey) = 0 
but this time we choose for /, the expression 
F(x) = (1 + x)*sin[a(x — 1)]. 
The boundary condition f,(1) =0 is already satisfied for all valucs of 
the parameters g and a, which are yet to be determined. 
To form M[F,] we evaluate 


(4 + x) FAY = [92 (4 + x)-* — 02(4 + 2)?*4] sina (x — 1) + 
+ (2q¢ +1) a(1 + %)?cosa(x — 1), 


1 For the special eigenvalue problems the enclosure theorem for the first eigen- 
value was proved by G. Temple: The computation of characteristic numbers and 
characteristic functions. Proc. Lond. Math. Soc. (2) 29, 257—280 (1929). 

2 This method is due to F. Kirszitinc: Fine Methode zur approximativen 
Kerechnung emseitig eingespannter Druckstabe mit veranderlichem Cuersctmitt. 


Z. Angew. Math. Mech. 10, 594—599 (1930). 
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and we see that for the quotient function ® of (8.25) to remain finite 
the zero of the sine factor in the denominator must be cancelled by a 
similar zero in the numerator. This can be achieved by choosing g = — 3, 
for then the cosine term disappears. 

We still have to satisfy the other boundary condition F,(0) =0, so 
we choose the remaining parameter a to be a root of the equation 


tana = — 24. 


Let a,, a), 43,... be the positive roots of this transcendental equation. 
With these values of a and g=—#4 


O(n) — + AY 


ee 
(+R 


1 
4(4 + 2)? (R2452, ele 
and inserting the maximum and minimum values of this function in 
(8.23) we obtain the limits 
1 
<1,sai— —. 
Thus we have obtained limits for infinitely many eigenvalues at one 
fell swoop. The constant difference between the upper and lower limits 
means that the percentage error is smaller for higher eigenvalues, and 
in actual fact this method is 
probably superior to all others 
Lower | Upper for the higher eigenvalues. 


limits for a, Several values are given in 
Table III/16. 


Table III/16. Bracketing of eigenvalues 


ay ay 


-8366 3734 4 344 ale : 
ee 6 Rk ee ee Generalizations of this 
7:917 62-68 62:43 62:62 bracketing theorem have been 

14-173 200:86 200°61 200:80 ; ‘ : 
17°308 209-56 29931 | 299-50 One formulation, which in- 


cludes all previously known 
bracketing theorems as special cases, is based on the Schwarz constants 
a, of (8.13). In it, real numbers },, d,,..., 5, are choosen arbitrarily 
and used, together with the first p +1 Schwarz constants do, 4, ..-, 4p, 
to define two closed sets M, and M, of real numbers x: AZ, consists of 


1 p 
all numbers * for which }"b,4’= . >' a,b, and M, consists of all 
a 


v=) v= 


1 Wievanpt, H.: Ein EinschlieBungssatz fiir charakteristische Wurzeln nor- 
maler Matrizen. Arch. Math. 1, 345— 352 (1949), and Fiat-Review, Naturforschung 
und Medizin in Deutschland 1939—1946, 2, 98 (1948). An older formulation was 
given by K. FRIEDRICHS and G. Horvay: The finite Stieltjes momentum problem. 
Proc. Nat. Acad. Sci., Wash. 25, 528 - 534 (1939); a detailed presentation has been 
given by H. BUckner: Die praktische Behandlung von Integralgleichungen (Er- 
gebnisse der Angew. Mathematik, H. 1). Berlin-Géttingen-Heidelberg 1952. 
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b p 
numbers x for which es a > a,b,. The theorem then states that 
v=1 Oye1 
there is at least one eigenvalue whose reciprocal lies in M, and at least 
one eigenvalue whose reciprocal lies in M,. 


8.7. Three minimum principles 


Ritz’s method for solving variational problems has already been 
applied to an eigenvalue problem}? (in §5) by deriving a variational 
problem whose Euler conditions can be identified with the eigenvalue 
problem in question. Now these Euler conditions, although necessary, 
are not sufficient for an extremum of the variational problem, and hence 
conclusions about the approximate values obtained cannot be drawn 
solely from the fact that the eigenvalue problem can be formally identified 
with them. However, for certain special classes of eigenvalue problem 
there are other variational problems, based on certain minimum prin- 
ciples of eigenvalue theory, which also have solutions satisfying the 
eigenvalue problem, but which allow specific statements to be made 
about the approximate eigenvalues obtained by solving them approxi- 
mately by Ritz’s method. We quote the results without proof. 

We now state the above-mentioned minimum principles. 


A. RAYLEIGH’s minimum principle. For a self-adjoint full-definite 
eigenvalue problem (8.1), (8.4), (8.5) with boundary conditions inde- 
pendent of the eigenvalue A the smallest eigenvalue A, is the minimum 
value of the Rayleigh quotient R[u] (8.9) in the domain of all com- 
parison functions (cf. § 8.1). 


B. KAMKE’s minimum principle®. Here fewer restrictions are 
imposed on u at the expense of the generality of the eigenvalue problem ; 
this is often of considerable advantage in practical work. This minimum 
principle applies to the same eigenvalue problems as RAYLEIGH’S except 
that one additional restriction must be imposed, namely that the 
eigenvalue problem is ‘‘A-definite’, a term which we now explain. 
Firstly the integrals appearing in the Rayleigh quotient (8.9) are put 


1 A comprehensive presentation based on the techniques of functional analysis 
is given by N. AronszajN: Study of eigenvalue problems. The Rayleigh-Ritz and 
the Weinstein methods for approximation of eigenvalues. Dept. of Math. Oklahoma 
Agricultural and Mechanical College. Stillwater 1949. 214 pp. 

2 Error estimates for self-adjoint full-definite eigenvalue problems have been 
obtained by G. Bertram: Zur Feblerabschatzung fiir das Ritzsche Verfahren bei 
Eigenwertaufgaben. Diss. 56pp. Hannover 1950. Other estimates and investiga- 
tions of the rate of convergence can be found in L. V. KAntrorovicu and V. I. 
Kry_Lov: Naherungsmethoden der Héheren Analysis, pp. 226— 329. Berlin 19506. 

3 KaMKE, E.: Uber die definiten selbstadjungierten Eigenwertaufgaben IV. 
Math. Z. 48, 67—100 (1942). 
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into ‘““DIRICHLET’S form” 


b bm 
JuM[uldx=f Di[u?Pdx+M[u], 
a ‘ ie Stes (8.27) 
fuN[uldx =f Ye,[uPdx + Nola]; 
a a »=0 
M,[u] and N,[u] are called the “Dirichlet boundary expressions’. By 
integrating by parts y times we transform a general term 


b 
S u(— 1)" [f, a] dx 
into aed 
i un”) ie 4) dx 
a 


plus terms involving only boundary values. The Dirichlet boundary 
expression M,[u] is then the sum of these boundary terms for all values 
of v, and N,[w] is found similarly. These boundary expressions are 
quadratic forms in the values of u, uw’, u’’,... at the boundary points 
x =a, x=b. If the two forms are positive definite when their variables 
are restricted to run through all sets of numbers satisfying the relations 
represented by the boundary conditions and if all the functions /,(x) 
and g,(x) are non-negative [previously the only. restrictions had been 
on f,,(x) and g,(x), namely /,,-+= 0, g,=: 0], then the eigenvalue problem 
is called K-definite. 

It can be deduced from the self-adjointness of the eigenvalue problem 
that the boundary conditions are such that, by suitable linear combi- 
nation, each boundary derivative of order greater than or equal to m 
may be expressed in terms of boundary derivatives of order 0,1, 2,..., 
m—1. Hence derivatives of order greater or equal to m can be eliminated 
from M,[u] and N,[w], which then become quadratic forms in (a), 
u'(a),..., wa), u(b), u'(d), ..., uw" (db). RAYLEIGH’s quotient (8.9) 
can therefore be put into the form 


j i f, [uw]? dx + Mo [1] 


Pale — aoe = 
S DSeylu™}2dx + Ny [u] 


a v=0 


(8.28) 


in which no boundary derivative of order greater than m—1 appears. 
KAMKE’Ss theorem then states that 2, is the minimum value of the 
quotient AK[w] in the domain of all admissible functions 4. 
C. A minimum principle for the special eigenvalue problems’. 
For those problems in which N[y] =go(x) y another minimum principle 


1 Cottatz, L.: Z. Angew. Math. Mech. 19, 228 (1939). 
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can be established under the conditions laid down in A for the applica- 
tion of RAYLEIGH’s principle; it is based on the iteration method. As 
mentioned in § 8.4, for the special eigenvalue problems the first iterate 
F, (x) in the iteration process may be chosen arbitrarily from among the 


comparison functions; its predecessor (x) in the iterative sequence is 
then given by 


F(x) = M[A]. (8.29) 


80 Bay 


Here the Rayleigh quotient (8.9) may be written as the Schwarz quotient 
fg, as in (8.16): 


R[u] = REF] =a, 


and we know from A that the minimum value of this quantity in the 
domain of comparison functions u is the smallest eigenvalue A,. But 
since the 4, decrease monotonically, we also have u,2A,. Now mw, may 
easily be expressed in terms of F;: 


b b 
SRNRldx SMR] ax 

— =* (8.30) 
fRNRldx fs RM[R)dx 


where fF is given by (8.29), and if we replace /, by u to emphasize its 
arbitrary character, we have 
b 


= fa. b . (8.34) 
futuy ax 


The minimum value of this quotient in the domain of comparison 
functions is the smallest eigenvalue 4,. In general R[w] is a better 
approximation to A, than ,[u] for the same function w but u,[™] can 
often be calculated rather more quickly. The extension of this minimum 
principle to the general eigenvalue problems is discussed at the end of 
§ 8.8. 


8.8. Application of RITZ’s method 


For any of the three minimum problems just described we can, as in 
Ch. I (4.1), assume a general expression for « depending on undetermined 
parameters and then write down the necessary minimum conditions to 
be satisfied by these parameters. Convenient equations are obtained if 
the expression for # is chosen to depend linearly on the parameters: 


th = AV, (x) + a@yve(%) Fee + AyU,(%), (8.32) 


Collatz, Numerical treatment, 3rd edit., znd print. 16 
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rather than in a general (non-linear) way. The 2, v2,--., Up will be 
chosen as fixed comparison functions which are linearly independent in 
<a, by. Then wu also will be a comparison function, and will vanish 
identically only when a,=4,=---=4a,=0. This case is therefore 
excluded. 

First let us consider RAYLEIGH’s principle. Substitution of (8.32) 
for u in RAYLEIGH’s quotient (8.9) yields 


bp p 
Sf 3 4,%,(%) D 4sM[0,(%)] dx 
1 


ei (8.33) 
f 2D 70,(%) y a,N[v,(*)] ax 
ar=1 s=1 


For convenience we now introduce quantities m,,,”,, defined by 


b 
n= J 2, (x) M{»,(*)] dx, 
[5 (8.34) 
nye = J ¥,(x) N[v,(x)] dx, 
which, on account of the assumed self-adjointness, possess the symmetric 
properties 
m,,=m,, and ,,=M%,,. (8.35) 


Then RAYLEIGH’S quotient has the form of a quotient of two quadratic 
forms Q,, Q, in the parameters a,: 


Q 
Raja 
a 
where : > 
?; == Ge, 0, = » nN, 4, a,. (8.36) 
7,S= t,s=1 


The assumption of full-definiteness (8.8) means that the numerator and 
denominator in R[w] can take only positive values (we have excluded 


the case a,=a,=---=a,=0); consequently Q, and Q, are positive 
definite quadratic forms. 
The necessary conditions for a minimum of Rie, ..., ap) read 
i) é 
OR _ Cs O58 =) mmdie 
yn meet 


The minimum value of R in this restricted class of comparison functions 
we denote by A: 
Av= min R[u(a,,..+, 4), 


and use it as an approximate value for the first eigenvalue J,. At the 
same time, of course, A is the value of Q,/Q, at the minimum and hence 
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the equations for the a, may be simplified to 


Now from (8.36) 


F) P F P 
xe =2 D1 mM, 54s, Gi = 2D Mee Mss 
s=1 


Oa, Oa, Fash 
so that the equations (8.37) can be written 
p 
2 4,(m,,—An,.) =O for r=41,2,...,p. (8.38) 
s=1 


These equations are called GALERKIN’s equations (cf. Ch. I, § 4.3). 
They are homogeneous equations for unknowns a, and have a non- 
trivial solution (i.e. one in which at least one a, is non-zero) if and only 
if the determinant of their coefficients vanishes: 


M,—Any, M1,—Aty. eee M,—Amy, 


Aegan. sAbi, = My,—ANg, Moz—AMge ... Mz,—ANng, =0. (8.39) 


See 8) * wi Me (@ 6) (e e, (ee ee eee ee esi he) we) ew 


This is an algebraic equation for A of the #-th degree and has p 
roots A,, A,,...,A,. Under the assumptions which we have made it 
can be shown that the # roots A, are real and positive, and that, when 
they are arranged in increasing order of magnitude, they furnish upper 
limits for the corresponding eigenvalues, i.e. 


Ave), for 1h =4, 2, .-.;2: (8.40) 


The technique of substituting a linear expression (8.32) for # can 
be used in exactly the same way for the other two minimum principles 
of §8.7. We derive the corresponding equations only for the third 
minimum principle § 8.7, C, but also show how they can be extended 
to the general eigenvalue problems. We deal first with a special eigen- 
value problem, for which the differential equation reads 


M[y] = Ago(x) 9 


and (8.31) is to be minimized. Proceeding as for RAYLEIGH’Ss principle 
we substitute for w an arbitrary linear combination (8.32) of # linearly 
independent comparison functions v,(x), which satisfy all the boundary 
conditions, and obtain 
_ OY 
py [4] = 02 , 


iltey 
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in which the quadratic forms Q%, Q? are here given by 


b 


a= fais (Demiee (de M{», (x) j)ar= > mea mk 


7,s=1 
where 
b 
Me, = ,(x)] M[v, (x)] ax, (8.41) 
and 
= n® a,a,, 
7; s==1 
where 
b 
n® = f v,(x) M[v,(x)] dx. (8.42) 


Thus the quantities © are formed in the same way as the quantities m, 
for RAYLEIGH’S principle. 

The rest of the calculation is identical with the corresponding 
calculation for RAYLEIGH’S principle if the notation Q,, Q,, ™,,,,, 1S 
modified with a superscript ®. The equations corresponding to (8.38), i.e. 


b 
2 4 (my, — Amy,) =0 (Pr=4,2, abe (8.43) 
s= 
are GRAMMEL’S equations!, and the approximate values A, are the 
zeros of the determinant 
ae me, — Ang, 
det (mm Hang) = a (8.44) 


ae ms, — Ans, 

In a practical application, saeco one in which the /, and gy 
are not simple functions, one would normally specify the functions 
M{[v,(x)} and calculate the v,(*) by integration, thus avoiding the 
numerical or graphical differentiation involved in calculating the 
M[v,(x)] from chosen v,(x). The determination of each v,(x) is equi- 
valent to the first step in the iteration method. 

We now turn to the general eigenvalue problem with the differential 
equation M[y]=AN[y]. Clearly we must go back to the original 


1 GRAMMEL, R.: Ein neues Verfahren zur Lésung technischer Eigenwert- 
probleme. Ing.-Arch. 10, 35—46 (1939). GRAMMEL derives the equations in a dif- 
ferent way. 

Practical examples are worked out by E. Maier: Biegeschwingungen von 
spannungslos verwundenen Staben, insbesondere von Luftschraubenblattern. Ing.- 
Arch. 11, 73—98 (1940). See also R. GraMMEL: Uber die Lésung technischer 
Eigenwertprobleme. VDI-Forsch.-Heft, Gebiet Stahlbau 6, 36—42 (1943). 
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definition of 4, in (8.30), which does not depend on the special form 
of N. Let us put 
p 


Eile tala 2, a7tte() 
then we have to determine a function F which is related to F, by the 
differential equation M[F,] = N[Fj], in accordance with (8.10), and which 
satisfies those of the boundary conditions sufficient for (8.12) to hold. 
Corresponding to each of the # functions v, we determine a function 
w,({x) such that M[v,]=N[w,] and which satisfies as many of the 
boundary conditions as are sufficient for (8.12) to hold, i.e. so that 
b 


J (w,N[¢] — pN[w,]) dx =0 (8.45) 


a 


for all comparison functions w(x). We can then put 
p 
Fy(x) = 2, 4, w, (x). 
r=1 


With this expression substituted in (8.30) we have again a quotient 
of two quadratic forms u,= Q?/Q/ but the numerator Q® is now defined 
by b/ p p p 
f= (S.aw.t9)(¥ aMlod)ax = ¥ mPa, 

rai s=1 


a 7,5=1 


where the m® are also defined differently: 
b 
me? = fw,M[v,] dx. 


The a, are determined to minimize y, as before, 1.e. from the equations 
(8.43), and A is determined from (8.44), but the new definition of the 
m;. is used instead of (8.41); the definition of the 7; (8.42) is unaltered. 


8.9. TEMPLE’s quotient 


The limits for the first eigenvalue A, given by (8.18) in § 8.3 may 
be extended to higher eigenvalues, and they then provide an alternative 
means to the Ritz method for the approximate location of the higher 
eigenvalues; they can also be used in combination with the Ritz method 
as in the example below. 

Starting with a function /j(*) which satisfies the same conditions 
as in § 8.3, we form the next function /,(x) in the iterative sequence 
generated by the iteration procedure of § 8.2 and calculate the Schwarz 
constants dy, 4,, a, and quotients “4, #2, as in (8.19). 
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We now assume that F(x) may be expanded as a uniformly con- 
vergent series of normalized eigenfunctions 4; (x), Le. normalized in the 
general sense: 

B © when i+] 
NiV.las = 
J | ( when 1=7. 


We may then write 


0 (x) = Lawl 


and assuming further that this series can be differentiated term by 
term sufficiently often we readily deduce that 


=> G4 (8.46) 
j=l j 


and 


4 


(& =0,14, 2). (8.47) 


“rald, 


The validity of this — can be established! when, for example, 
the eigenvalue problem (8.1), (8.4), (8.5) is self-adjoint and full-definite, 
N[y] has the special ‘‘single-term”’ form 


N[y] =(—1)"[8n(x) YJ = with g, (x) > 0, 
the boundary conditions include the equations 
y(a) =y'(a) = =" M@ =O) =) =-- = HN} =0 


and F(x) is a comparison function. 
From the Schwarz constants we now form the “Temple quotient” 


a 
T()= Samui ge IL = fs oe 
ay ay a, Mg -t 
as (8.48) 


Here ¢ is an arbitrary parameter restricted only by the condition that 
it shall differ from fa. This quotient 7(t) can easily be expressed in 


1 See L. CoLratz: Eigenwertaufgaben. Leipzig 1949. pp. 144 and 1914. For 
formula (8.54) the assumption that Fj(¥) is a comparison function can be replaced 
by the weaker conditions specified for Fj(*) in § 8.3; the proof of this is given 
by N. J. Lenmann: Beitrage zur numerischen Lésung linearer Figenwertprobleme. 
Z. Angew. Math. Mech. 29, 341—356 (1949); 30, 1—16 (1950). 
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terms of the expansion coefficients c; via (8.47): 


j= ose ee (8.49) 


Now 


and since the sum of the series which occurs both in the numerator here 
and in the denominator of the quotient for T(é) — A, cannot be zero (we 
have assumed ¢= y.), we may multiply the two quotients together and 
cancel: oo 


(TQ) — A) (a —f) = 2 (8.50) 


Let the eigenvalues be arranged in ascending order of magnitude, as 
in § 8.1 (our assumptions imply that A, >0 but the present considerations 
are also valid for A,<0). Whether A, is simple or multiple, there is a 
next smaller eigenvalue A,_ and a next larger eigenvalue A,, (unless 
A,=4,, when A, does not exist). Thus we have 4,_<A,<A,, and no 
eigenvalue other than A, lies between A,_ and A,,. When A, is simple, 
A,-=A,_, and A,, =A,41. 

Now the numerator of the quotient on the right-hand side of (8.50) 
cannot be negative if ¢ lies in the interval 2,_<t<A,,; moreover, the 
denominator, whose value is a,, is always positive since the eigenvalue 
problem is assumed to be full-definite. Consequently 


(T() —A,)(H2—-4) 20 for A, StSa,,. (8.51) 
This implies that 


(8.52) 


T(t)=A, when t<p, 
and 


Tit) SA, when t>pe, 
provided always that A,_ S/<A,,. 
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It can be seen immediately that the limits (8.20) for the first eigen- 
value are special cases of this result: if we know that a number 1, 
greater than jug, is a lower limit for A,, then (8.52) gives T(t) <A,, which 
is precisely the lower limit in (8.20); if we take the limit as ¢-» — oo in 
(8.48), we obtain T(— cc) =.= A,, and hence the result also includes 
the upper limit in (8.20). 

For higher eigenvalues we can summarize thus: If we have an 
approximation F,(x) to an eigenfunction y, corresponding to the eigen- 
value A, which is sufficiently accurate that the Schwarz quotient yu 
which it generates lies in the interval A,_<p.<A,,, and if also we 
know an upper limit L,_ for A,_ and a lower limit /,. for 4,. which 
are both so near that 


Ae (Rey re (8.53) 
then A, is bracketed by the values T[/,,] and T[L,_]: 


Example. As in § 8.5, we again treat the problem 
—({(t+x)9S=A0 +2), “9 O =y70)—0 


by assuming a polynomial expression for F,(x). This time, however, 
we use a polynomial of higher degree with an extra arbitrary constant 
so that in addition to satisfying both boundary conditions on F, and 
the essential boundary condition on A, which yields 


F(x) == -_ {c,(14 + 284% — 18x*— 24x5) +0,(5 + 4x — 9x4)} 


F,(«) = €, (41 — 14x? + 3 x4) + ¢3(3 — 5x2 + 224), 


we can determine the ratio c,:c, of the remaining free constants to 
make F,(x) approximate the second eigenfunction. The Schwarz con- 
stants generated by this A(x) (cf. § 8.5) are 


ag=4 { 204-9614ci + 2X 53-06142¢,¢,+ 14-11142¢5} 


a, = s {2619-8 c?+2X693-2 cyeg + 184-4 3} 
Oy= 5 {1623-3 f+ 2x 2833 oyeg + 114-4 ah 
One way of determining the ratio c,:c, would be to put c,=—1, 
calculate the limits (8.54) for different values of ce, and then interpolate 
for the value of c, which gives the narrowest limits. Here it is con- 
venient to apply the Rayleigh-Ritz method with F,(x) as the assumed 
form of approximate solution; we have already calculated the expres- 
sions for a, and ag, i.e. the quadratic forms Q, and Q, of § 8.8, and can 
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write down immediately the Galerkin equations 


(2 x 2619-8 — A x1623-3) c, + (2693-2 A | og == 


(2 x 693-2—Ax a cy + (2184-4 —AX114-4) c,=0. 


4 
The determinant of the coefficients is a quadratic expression in A, 
whose zeros 
A,= 3-21850 
ves 1= 3 505 
Ae = 23-189 7 


are the Rayleigh-Ritz approximations to the first and second eigenvalues. 
We take A =A, and solve the corresponding set of homogeneous equa- 
tions to obtain 

¢=1, cy=—}3-76605. 


With these values we have 


ay = 45-441 or a, =2xX0-45985, a, = 0-:039664, 
[ty = 23-667, fz = 23-190, fy — Ma = 0-48. 


Since w, is equal to the Rayleigh-Ritz approximation A,, we know 
immediately that u,=24A,. [This is a smaller upper limit than that given 
by (8.54).] 

In order to calculate a lower limit for A, from (8.54) we need a rough 
lower limit for A,. If, as in § 8.5, we compare with a problem having 
constant coefficients, we obtain a very crude lower limit 


a = mc? re 30-8. 


It is greater than w,, however, and can therefore be used in (8.54); it 
yields 
T (ls) = 21-735 S Ag. 


This limit will be improved if we can deduce a better lower limit for Ag; 
for example, /,—60 would give 


T (60) = 22-888 Sy. 


8.10. Some modifications to the ite: 1tion method 


Theory shows that the ordinary iteration (8 10) will converge to the 
g-th eigenfunction if F(x) is chosen so as to be orthogonal in the gener- 
alized sense to the first g—1 eigenfunctions. In practice these first 
qg—41 eigenfunctions are not known exactly and therefore their com- 
ponents cannot be excluded completely from Fj(x) and subsequent 
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iterates. In a modification of the iteration method given by Kocu? 
the unwanted components, which would otherwise become dominant, 
are suppressed by subtraction at each stage of the iteration of the 
components of the best available approximations Y; to the first ¢—1 
eigenfunctions. Thus the direct relation (8.10) between F, and F,_, 1s 


replaced by 
M[F."] =N[F-a], 
ULF] = 0, 
1 Y,fRENW dx | (F=1,2,--.). 


7 
F, = F* — Jo a 


6 
jaa f Y/N(Yj]ax 
a 


Another modification?, which occasionally improves the convergence 
of both this modified iteration and the ordinary iteration (8.10), consists 
in replacing M[F,] by M[F,—0F,_,]. Thus the iteration (8.10) is 
modified to 


M[F,-—OFaJ=NAaul, GIR)=0 (&=1,2,...). 


Assuming that the expansion theorem is applicable we may then write 


R=Lox(0+7z) B= Darl? +z) 1,2.) 


in place of (8.46). 
One can go a step further and use a different # in each cycle%, in 
which case the iteration formula becomes 


Mi -O,FR-1=NR), UlRl=0 (k=1,2...) 


and the expansion formula must be modified to 
= S . . : 1 ots 1 — ay 


1 Kocu, J. J.: Bestimmung hoherer kritischer Drehzahlen schnell laufender 
Wellen. Verh. 2. Internat. Kongr. Techn. Math., Ziirich 1926, pp. 213—218. 

Another method is given by A. FRAENKLE: Ing.-Arch. 1, 499—526 (1930), 
specifically ‘“Methode II’, p. 510 et seq. A method of minimized iterations has 
been devised by C, Lanczos: An iteration method for the solution of the eigenvalue 
problem of linear differential and integral operators. J. Res. Nat. Bur. Stand. 45, 
255—282 (1950). 

2 Developed for integral equations by G. Wi1arpA: Integralgleichungen unter 
besonderer Beriicksichtigung der Anwendungen, p. 126. Leipzig 1930. 

3 Developed for integral equations by H. BUcKNER: Ein unbeschrankt anwend- 
bares Iterationsverfahren fiir Fredholmsche Integralgleichungen. Math. Nachr. 2, 
304 — 313 (1949). 
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If approximations A, are known for, say, the first p—1 eigenvalues 
Aj, One can put 


1 
Vo 0340 = Oypt0 = — G- 

Co 
O = 805 =0 


This furnishes another iteration method for the #-th eigenfunction 
provided that the approximations A, are sufficiently accurate. 


feo 452,25 P — 41, ¢ = 152,300 


8.11. Miscellaneous exercises on Chapter III 


1. The stress distribution in a rotating disc (a steam turbine rotor, say) of 
thickness 4(v) and radius R may be calculated from the differential equation! 


2 ear oes ST eh: 
aA I) m 686 


Y 
72 SY 4 r(3— — ‘| S’— 
” n 


Here ry is the distance from the axis of 

rotation (Fig. III/15), S(r) = 9 (r)o,, where 7 
6, is the radial stress, and m, y, @, g are 
constants (usual notation as in reference! 

below). If we consider a thickness profile s 

of the form 


O=——— - j 
Aig ( 2r y Fig, III/15, Radial section of the disc in Exercise 1 
FR 


and introduce the dimensionless variables 


then the equation with m= 3 reads 
4h 5 f 4 
(1+ 2?) y +(2452)¥+Sy+1=0, (8.55) 


in which the dashes now denote differentiation with respect to »%. 
Calculate y(x) by the ordinary finite-difference method with interval h= b, 
say, for the case in which the boundary conditions are 


y(2)=06, y regular at ¥=0, 


i.e. for a solid disc with given radial stress at its edge r= R (¥ = 2). 
2. Failure of the finite-difference method. Show that for the boundary-value 


problem 
xy’=cy’; y(0)=0, y(i)=1 


the solution given by the ordinary finite-difference method is always partly of the 
wrong sign when c>2 (when c= 3, for example). 


1 BrezEno, C. B., and R. GRAMMEL: Technische Dynamik, 2nd ed., Vol. II, 
p- 25. Berlin-Géttingen-Heidelberg 1953. 
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3. Show that the solution of the non-linear problem 


2x2 
y=, eat 


given by the ordinary finite-difference method is exact. 
4. The boundary-value problem 


y’=y?;  y(0)=0, y(2)=—2 


possesses only complex solutions. Determine one of these solutions roughly by 
the ordinary finite-difference method. 

5. The boundary-value problem y”=0; y(0)=1, y(4)=¥’(1) has no solution. 
Can the method of § 5.2 be applied to obtain a variational problem whose Euler 
conditions are identical with this boundary-value problem ? 

6. Show that the variational problem corresponding to the boundary-value 
problem 

y’+4y=2, y(t1)=0 


according to the formulae of § 5.2 possesses neither a minimum nor a maximum. 
Can one still apply the Ritz method, say with a polynomial approximation of the 
form 


p 
y= D1 a,(1 — 47”). 
v=1 
7. Failure of the Ritz method. The non-linear boundary-value problem 
yi Vi Ane Yileeks 10 


represents the Euler conditions of the variational problem 
1 

Jigl=JS (§9’3+4%9]d*% = extremum 
-1 


with the auxiliary conditions g(+1)=0. The boundary-value problem has two 
solutions symmetrical about *# = 0, namely 

y=1—22 and y= +?—1. 
Apply Ritz’s method with the approximation 


p p 
y= Da,(i—+x*”) or p= Da,cosynx. 
v=1 y=1 


8. Bracketing of eigenvalues. Use the enclosure theorem (§ 8.6) to calculate 
upper and lower limits for some of the smaller eigenvalues of the eigenvalue 
problem 


~¥=A(2—47)y;  y(0)=0,  2y(1)+ ¥/(1)=0. 


(This represents the vibrations of an inhomogeneous string with one end fixed 
and the other constrained to move transversely under an elastic force.) 


9. Use Ritz’s method with the two-term approximation 
p = a, (1 — x4) + a, (1 — x) 
to find the symmetric solutions of the eigenvalue problem 
y= (my, yan ee, 


which represents the vibrations of an inhomogeneous string fixed at each end 
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10. Find upper and lower limits for the first eigenvalue of the problem of the 
previous exercise by using the iteration method and the theorem of § 8.3 


11. Apply Ritz’s method to the eigenvalue problem 
y= Ait x)y9s (0) = 9'(0) = ¥"(1) = 9/1) = 0 
(transverse vibrations of a cantilever of variable cross-section but constant flexural 


rigidity) with two-term and three-term polynomial approximations. 
12. What is the Euler differential equation (6.9) for the variational problem 


b 
Jip] =f tz) 9 ot) dx = min., 


where m=>1 and f(#) is a given function of x with a continuous second derivative ? 
No boundary conditions need be specified for this. 

13. Someone asserts that in the application of Ritz’s method to 
boundary-value problems as described in §5 the addition of extra 
boundary terms to the integral, as in (5.6), and the recognition of two 
quite different types of boundary conditions — essential and suppres- 
sible — are quite unnecessary and that all one need do is simply to 
restrict the admissible functions to the domain of functions which 
satisfy all the boundary conditions and use merely the integral whose 
Euler equation coincides with the differential equation in question. 
Thus for the problem 


y’=0; y(0)=y'(0), y(t) =14, 


for example, one would consider the variational problem 
Z 
J*(p] = J p'?dx% =min. 
0 


subject to the auxiliary conditions g(0) = ¢'(0), p(1) =1 and argue that 
the minimizing function y(x) must satisfy the boundary conditions since 
all admissible functions satisfy them and must also satisfy the Euler 
equation y’’=0 and therefore it must be the solution of the boundary- 
value problem. Comment! 


8.12. Solutions 
4. The singularity at x =0 in (8.55) implies that for a regular solution we must 
have y’(0)=0. Now es 2 = y’’(0), so that 
t—-> 


ia (2 +5) y= 390) 
x 


x—>0 


hence for the point x= 0 the differential equation (8.55) can be replaced by 


4y’+$yt1i=o. 


254 III. Boundary-value problems in ordinary differential equations 


With Y_;=Y; (on account of symmetry) we obtain the difference equations 
(s=0) 16(2¥,—-2¥%)+3%+1=0, 
(g=4) 5(4—2%,7 %) 1, — %) ee — 


and two more similar equations corresponding to the points x=1, *= 3. If we 
then express Y,, Y,, ... successively in terms of Y): 


Y, = 0:958 333 Yo — 0°03125, 

Y, = 0874486 Y, — 0:094 136, 
Y3 = 0°801 612 Y, — 0-148 791, 
Y, = 0'742773 Y) — 0:192920, 


the condition Y,=0-6 yields 
Y, = 1-067 514, 
and hence 
Y, = 0°991 784, 
Y, = 0-839390, 
Y, = 0°706941. 


2. The exact solution of the boundary-value problem is y = x'** and 
is positive throughout the range 0<*<1. With the pivotal interval 
h=1/n the difference equation corresponding to x =h is 


¥%-2%+% _, %—% 
i nh? ry a 


which on account of the boundary condition 4,=0 reduces to 
a 
iG 5 ee 


Consequently Y, and Y, always have opposite signs when ¢c>2. Thus 
the finite-difference method yields at least one pivotal value Y, with 
the wrong sign for all the values of 4, however small. For the numerical 
example c=3, h=#4 the exact solution gives y(4) = j, and the corre- 
sponding finite-difference approximation is Y,=— 4. 

3. The exact solution y == x? is a parabola and for a parabola no error 
is introduced by the substitution of the second difference quotient for 
the second derivative. Thus, for example, with h = § we have y(4) =4 

lnc, ee 


and this value for Y, satisfies the difference equation a = 


woo OY, 
4. Using the pivotal interval h=1 we find that y(1)~%—1-+7. 
With 4= % the approximate solution with positive imaginary part is 


y (3) & — 0-65 + 0-877, 
y (%)  — 1-45 + 1-247 
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and with h =} it is 
y() & — 0-500 + 0-728, 
y (1) & — 1-070 + 1-275, 
¥ (3) & — 1-760 + 14-1397; 


the complex conjugates of these values give the other solution. 


The more accurate approximations with / = 2/7, #=3,4,..., which 
require the solution of systems of two or more equations, are obtained 
by interpolation. We take several values of y(h) covering a range 
suggested by the very rough approximation y(1) @ —1+7, which indi- 
cates how the solutions for 
smaller # run, and for each 
of these values we calculate 
y(2h), y(3h),... from the 
difference equations. A value 
of y(h) for which y(nh) + 
20 is then determined by 
two-dimensional interpola- 
tion. 

The solution can be re- 


i Fig. I1I/16. The complex solution of a real boundary-value 
garded as the parametric problem 


(parameter x) representation 

of a curve in the complex y plane which joins the points y=0O and 
y=—2. Fig. III/16 shows the approximations for the points on this 
curve obtained with h=# and h=; the calculated points are shown 
as small circles. 


5. Yes. The required variational problem is 


J{¢] = foaer — [p (1) ]? = extremum 


subject to the auxiliary condition g(0)=41. It also has no solution: 
with y=1—ax, J[y] becomes 2a—1, which can take all values. 


6. From (5.19) the corresponding variational problem is 
1 
Tig] =S (— 2? +492 — 49) dx = extremum 
=r 


subject to the auxiliary conditions y(+-1)=0. That J[g] has neither 
a maximum nor a minimum in the domain of continuously differentiable 
functions g(x) with m(+1)=0 can be shown simply by exhibiting 
functions in this domain which give the integral arbitrarily large positive 
and negative values; such functions are 


gp =a(—1+*), whichyields J[p] =8(§4?+ 4a), 
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and 
gy =a(—x2+4x4), whichyields J[p] = — 8 (§a?— Za). 


However, for p= y, where 


is the solution of the boundary-value problem, J[g] has a stationary 
value; thus the first variation 6/ still vanishes when y=y and con- 
sequently Ritz’s method still gives significant approximations. The 
stationary character of J/[q~] for gy =y can be seen clearly from the form 
it takes when we put p=y(x)+e(x) with e(+1)=0: 


Jl¢] =Jiy] +f (ae e’'2)\dx, where J[y] =tan2—2. 


For the two-term Ritz approximation m= a(1— x*) +6(1—+#*) we have 


1 4 Py) 44 a 4 
as a a2 (ERIN, 2 b ae Baie, eee ee: b 
8 J{¢] 5 a 108 + a4 = 
and from oy = 0), ay =0O we obtain a= oe, b= — a. these values yield the 
0a ob 3 41 
approximate solution g = = (s — yy aC — #4) and in particular ¢ (0) = * x 
3 


1:69697 (error —0-3%). 

7. For both of the suggested Ritz approximations for g it turns out 
that J[y]=0; this happens, in fact, for any even function [¢ (x) =¢(—2)], 
for J is then the integral of an odd function over a symmetric interval. 
Consequently the a, cannot be calculated from the equations @ J/éa,=0. 

8. If we try an approximation of the form 


F, = f(x) sin(g(+)) 
and calculate 


FyY,Fy and ®@=— ae ; 
we find that the special form 
F,= (1+b%)~*sin|a (+ + Lana 
is particularly convenient. This gives 
a? &2 — ; Hi 
Co — ae where §=1+ 5x. 


The boundary condition 2 (1)+F,(1)=0 remains to be satisfied; it implies a 
relation between a and b, which, if we put y=a(i+ $d), can be written 
tany —4(1+06)? 
y (4 + 36) (2+) © 
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We now choose a value for b and calculate several of the smaller of the infi- 
nitely many corresponding values of y. Each of these defines a value of a and 
hence a corresponding ®(x), whose upper and lower bounds ®max and ®min give 
upper and lower bounds for an eigenvalue. By varying b we can easily see when 
the limits become narrower. Trials with b= — 0:3 and — 0-25 show that the best 
values are obtained with say 6 = — 0:285. The limits for the first three eigenvalues 
calculated with this value of 6 are included in Table III/17. 


Table III/17. Bracketing of eigenvalues 


b | Y | a CS EC ee 
~0:3 { 2°409 2°834 3-2454,5 3-98 
5-190 6-106 15°2 =A, = 18:61 

0-25 { 2:385 2°726 3:2254,S 4-10 
toy 5-906 15°24 SA, S19°5 

| 24028 28021 32554, 3-90 

—0°285 5-1832 6°044 5 15-255 A, S 18:56 
81665 | 9°5236 | 37:3 SA,=46-25 


9. Here we have 


af 
1 1 Ps 
Sig = f to? Aa +4) Plas 4 (Fat + 2-2 aay + = a) — 
0 


- aie BEZay. | 
32.4 (7 az + 45 @,a,+ 3465 ai). 


If 8A =3y, the determinant condition for the equations dJ/@a,=0 for y= 1,2 
reads 


64—35 74¢—42 
92 
= ——p—6 
| i 42 t= 60 
which yields the quadratic 


13?— 7124 + 3696 =0. 


The roots of this equation yield upper bounds for the first and third eigen- 
values since the second corresponds to an antisymmetric eigenfunction: 


3 aaa) J 2177486 2A, 
Aya = 36 (89 + V4918) = | 18-361 Sdy. 
10. According to (8.10) the first iterate is to be calculated here from 
=e eee ie «6 N(Gae)) awe 


Starting from A= 1 — +? we obtain 


1 
x= 
es 


Collatz, Numerical treatment, 3rd edit., 2nd print. 17 


(14 —15+2-+ 28). 
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Then we calculate the Schwarz constants (8.13): 


1 
ae 2) Fed, — 4. 
pom f ita) Biae= 105 
a 


4 3232 14 32x 32564-8 


a=,  — a= 
2 BS) oS SS 2 900 xX 9009 


and from them the Schwarz quotients (8.11): 


_ 4% _ 220 a 

Ll as == raaa 3 Pha lak Ph 
ae — 177253 _ - 

He dy 81412 pte 


For the application of formula (8.18) we need further a lower limit /, for the 
second eigenvalue A,, or here a lower limit /, for the third eigenvalue A, since the 
second eigenfunction is antisymmetric and we are considering here only sym- 
metric modes — this is because we chose a symmetric starting function Fy (+), 
which can therefore be expanded in a series of symmetric eigenfunctions (cf. § 8.9). 
The third eigenvalue for the comparable problem with constant coefficients 
—y"=2Ay, y(41) =0 is 97/8 and using this value for /, in (8.18) we obtain the 
narrow limits 

2°177034 SA, S 2177259. 


41. According to (6.20), (6.21) the corresponding variational problem reads 
1 
Jigl= Sly’? AQ +4) @]dx = extremum, (0) = ¢’(0) = 0. 
i) 


For the three-term approximation g = a, x*+ a, #5+ a,24 the conditions 0 J/¢@a,= 0 
(v= 1, 2, 3) yield three linear homogeneous equations whose determinant reads 


bles ort Cas" 8—--— A 
3 15 a7 
6——A 12— A bie) A ' 
15 17 144 19 
——A 18—-——A —— 4 
6 72 5 of al 


where A is an approximation for A. With »=A/1008 the usual determinant con- 
dition reduces to 
51758 — 4463424 13554 — 90=0, 


from which we obtain 


0-307 310 
8°33 $390. 
For a two-term approximation (g without the term a, +‘) the determinant is 


the sub-determinant of the above determinant indicated by the dotted lines, and 
if A = 840 u the determinant condition becomes 425 u?— 369 4+ 3=0; this yields 


the values 
vee { 6°8944 
Vine: 


0-006 7920 68464 
i= Ars 
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12. A possible solution y must satisfy the differential equation 
ZF (x) ym] 0m) +. [f/7(x) ylm—2](m—1) — 0 
as can be verified by simple manipulations with the aid of the binomial coefficients. 


13. The assertion made is untrue. The Ritz method, say with the 
approximation 


p(x) =3(4+ N+d6 (4 +x — 2x77), 


which satisfies all the boundary conditions, would yield solutions 9, (x) 
which converge to a limit function w(x) as m increases, but this limit 
function would not be the solution of the given boundary-value problem; 
for it is determined by the boundary-value problem y’’=0; y’(0) =O, 
y(1) =1, in which the suppressible boundary condition g(0) = y'(0) has 
been replaced by the natural (for the suggested variational problem) 
boundary condition p‘(0) =0, and for the solution of this boundary-value 
problem w(0) = y’(0). Thus one could not recognize the approximations 
as false from the fact that they do not converge; for this reason it is 
critically important that the variational problem be formulated cor- 
rectly. 

The variational problem suggested in the question, namely /*[p] = 
minimum, 9(0) =9'(0), ~(1) =1 has no solution; with g subject to 
these boundary conditions /*[g] has the lower bound zero, and this 
is assumed for the function g=1, for which g(0)=+¢’'(0), but not for 
any comparison function. For the solution of the given boundary-value 
problem, namely p=y=}(1+-), J* assumes the value /*[y]=7, 
which is not a minimum. The comparison function 


_— jaseer tare for OS *xSe 
QP\x 


4 fOr (cea 


with e«>0 


gives J* the value 


3 an i 
il Se 9 


and by choosing ¢ small enough 
we can make this value as 
close to zero as we please. As 


- ries 
é decreases the Ritz approx- ~7 Pie -_ 
A . ’ Fig. 111/17. Ritz approximations for a variational problem 
imations represented by this with no solution 
family of comparison functions 
approximate more and more closely the function p = 1 (see Fig. III/17), 


yet the solution of the boundary-value problem reads y =4$(1+2). 
47" 
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According to §5 the correct variational problem corresponding to the 
given boundary-value problem reads 


Jie] SD + [p(0)]? = min., 


where y need satisfy only the essential boundary condition y(1) =1. 


Chapter IV 


Initial- and initial-/boundary-value problems 
in partial differential equations 


The need for a sound theoretical foundation 


In Ch. II, §§ 4.2, 1.3 some fundamental difficulties associated with 
the treatment of initial-value problems and error estimation for the 
approximate methods used were discussed with regard to ordinary dif- 
ferential equations. Naturally these difficulties are amplified when 
partial differential equations are considered; but over and above this, 
partial differential equations give rise to an extraordinarily large vanety 
ot phenomena and types of problem, while such essentials as the existence 
and uniqueness of solutions and the convergence of approximating 
sequences are covered by present theory only for a limited number of 
special classes of problems. These theoretical questions have not yet been 
settled in a satisfactory manner for many problems which arise in 
practical work. When confronted with such a problem one may be 
forced to rely solely on some approximate method, a finite-difference 
method, for example, and hope that the results obtained will be sig- 
nificant. Naturally such a procedure is not only unsatisfactory but 
even very questionable, as will be enlarged upon more precisely below ; 
nevertheless, it is often unavoidable when a specific technical problem 
has to be solved and a theoretical investigation of the corresponding 
mathematical problem is not asked for. Consequently there is a pressing 
need for the accumulation of much more practical experience of approxi- 
mate methods and for research into their theoretical aspects. 


That an investigation of the situation ts absolutely essential 1s revealed 
even by quite simple examples; they show that formal calculation applied 
to partial differential equations can lead to false results very easily and 
that approximate methods can converge in a disarmingly innocuous manner 
to values bearing no relation to the correct solution. 
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Consider, for example, the problem 


(x, 0) = cos x 
Ou au , LL 


Oat 898’ oy 
u(a: Z, y) =siny for yaet0. 


for |x) < = 


This describes the oscillations of a string of length a which is initially 
(y=0) at rest in a displaced position defined by u(x, 0)=cos x and - 
which is periodically excited at its ends (w= -+2/2). 
Let the solution be expanded as a power series in the neighbourhood 
of the point *=0, y=0: 
od Pa I ST i 

By inserting the series in the differential equation and equating coef- 
ficients we find immediately that the a,,,, must satisfy the recursive 
formula 

ees 

mere (n+ 2)(n+1) 4%" 


This relation enables us to express all the a,,,, with #22 in terms of 


the a, 5 and a, ,; in particular, 


mn 


Ay eg= 4290 for g=0,1,2,.... 


To satisfy the initial condition u,(x,0)=0 the a,,, and hence the 
Ay2q¢+1, Must all be zero. The other initial condition (x, 0) =cos x 
determines the remaining a, 9 (=4p,,) with even Rk: 


— 0" when & = 2g is even. 
(29)! 


On the y axis, i.e. when x =0, the power series BO 
A LD» 
as 


(0) when & is odd 
ayo = ( 


becomes a 0 
fore) co 
hee (— 1)? aa Fig. IV/4. Region outside 
> 49k ae ye (2q)! y COE. of which the power series 
k=0 g=0 2 solution breaks down 


which converges for all y, and hence represents its sum function cos y 
on the whole v axis. Nevertheless, cosy is not the correct solution 
along the whole y axis; in fact «(0, vy) takes the value cos v only on 


that part of the y axis cut off by the characteristics y . {x emanating 


from the points A ; 0}, (— F 0), respectively (see Fig. IV/1). 
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It is not difficult to construct similar examples for which the power 
series gives the wrong solution in every interval of the y axis, even 
though it converges for all values of y. Such a situation arises, for 
instance, if in the previous example we replace the initial displacement 
u(x,0)=cosx by u(x, 0) =e—"/")4cx2, where ¢ is chosen so that 


u( a 0)=0, and calculate the coefficients a, from the values of 


the derivatives of u at the point x =y =0 [in this case, of course, even 
u(x, 0) is not represented by the power series]. 

It is therefore very desirable, if not essential, that an approximate 
treatment of a problem in partial differential equations should be 
coupled with theoretical substantiation of some sort. In this book we 
cannot develop the theory for each type of problem considered, so the 
reader must refer to the textbooks on partial differential equations for 
theoretical details!. We shall, however, make use of the results of the 
theory. 


§1. The ordinary finite-difference method 


Because of its importance for applications, this section is written very com- 
prehensively and much is repeated from earlier sections so that the reader need 
refer back as little as possible. 


The ordinary finite-difference method provides a simple, general 
method by which one can obtain a reasonable quantitative idea of the 
solutions of many problems in differential equations. The accuracy 
achieved is not usually very great but often suffices for technical prob- 
lems. Refinements of the method will be discussed in § 2. 

To simplify the presentation we limit ourselves for the most part to 
problems with two independent variables x, y, although the method 
may be applied in exactly the same way to problems with more than 
two (see the example in § 1.8). 


1 Of the numerous textbooks we may mention — Courant, R., and D. HILBERT: 
Methoden der mathematischen Physik, 2nd ed., Vol. 1, Berlin 1931, 409pp.; Vol. 2, 
Berlin 1937, 549 pp.; English edition, London 1953. — Kamke, E.: Ditferential- 
gleichungen reeller Funktionen, 2nd ed., Leipzig 1944, 442 pp. — Differential- 
gleichungen, Lésungsmethoden und Lésungen, Vol. 2, Leipzig 1944, 243 pp. — 
FRANK, Pu., and R.v. Mises: Die Differential- und Integralgleichungen der 
Mechanik und Physik, 2nd ed., Brunswick, Vol. 1, 1930, 916 pp.; Vol. 2, 1935, 
1106 pp. — Horvy, J.: Partielle Differentialgleichungen, 3rd ed. Berlin and Leipzig 
1944, 228 pp. — SOMMERFELD, A.: Partielle Differentialgleichungen der Physik 
(Vol. 6, consisting of lectures in theoretical physics). Leipzig 1947, 332 pp. — 
WEBSTER, A.G., and G. SzreG6: Partielle Differentialgleichungen der mathe- 
matischen Physik. Leipzig and Berlin 1930, 528 pp. — Courant, R., and 
K. FrRrIEDRICHS: Supersonic flow and shock waves, Interscience Publishers Inc. 
New York 1948, 464 pp. — BERNSTEIN, Dorotuy L.: Existence theorems in partial 
differential equations (Annals of Mathematics Study 23). Princeton 1950, 22S pp. — 
SauER, R.: Anfangswertprobleme bei partiellen Differentialgleichungen. Berlin- 
Géttingen-Heidelberg: Springer 1952, 229 pp. 
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1.1, Replacement of derivatives by difference quotients 


We base the finite differences on the pivotal points 


Ve =Vothl 


which may be defined as the nodes of a rectangular mesh made up of 
the “mesh lines” »=x;, y= yj (t, k=0, +1, +2,...) displaced by the 
“mesh widths” # and J, respectively 
(see Fig. IV/2); (%, ¥o) is any con- 
veniently chosen origin for the ‘‘mesh 
co-ordinates” 7, . A square mesh is 
a rectangular mesh with h =1. 

Meshes other than rectangular can 
also be used (see Ch. V, § 2.7) but in 
general the resulting finite-difference 
expressions are more complicated and 
less convenient for numerical work, 
particularly when the chosen mesh 
cannot be transformed into itself by 
a translation}. 

Function values at mesh points, the pivotal values, will be charac- 
terized by the appropriate subscripts; thus w;, will denote the value 
of the exact solution u(x, y) at the mesh point x=x;, y=y,. U,, will 
denote an approximation to the pivotal value 4; ,. 

Just as for an ordinary differential equation (Ch. III, § 1), the partial 
differential equation is replaced by a difference equation which is derived 
by the substitution of an appropriate difference quotient for each de- 
rivative occurring. 


(i,k =0, +1, £2,...), (1.1) 


Fig. IV/2. The rectangular finite-difference mesh 


This difference equation is not necessarily unique, for there are often several 
choices of appropriate difference quotient; for example, the derivative (du/0y); , 
can be approximated by any of the following three difference quotients: 


Ei a U; 
the ‘‘forward’’ difference quotient eee LE eis , (452) 


spa U; pe PAE! 
the “backward” difference quotient Uisk iene = a (1:3) 


: U; — U; p— A 
the ‘‘central’’ difference quotient i fekt ¥ El at ee ie Writ U,,). (14) 


1 For the Tricomi differential equation k(y)u,,—Uyy=/(%, ¥) K.H. BavErs- 
FELD: Zum Differenzenverfahren bei Anfangswertaufgaben partieller Differential- 
gleichungen 2. Ordnung. Diss. Hannover, 1954, uses a rectangular mesh whose 
mesh width in the x direction is kept constant while its mesh width in the vy direction 
is varied so that the mesh diagonals are chords of the characteristics. 
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The subscript y to the forward difference operator 4 defined in Ch. I, § 2 signifies 
that the operand is to be regarded as a function of y alone; thus the effects of A, 
and A, operating on any function of ¥ and y are 


A,g(#,¥) =e(4 +h, y) —e(%, 9), \ (4.5) 
Ay g(%, 9) = g(x,y + h) —F(*, 9) 


and on a discrete ‘“‘mesh function”’ g;, 


Ag 8ik= Bitar — Ciky Ay Bin= 8i,n+1— Gik- (1.6) 


It is well known that in general the central difference quotient is a substantially 
better approximation to the local derivative than either the forward or the backward 
difference quotient. One might think therefore that it is best to use only central 
differences in numerical work. In fact, as is demonstrated in § 1.3, this often 
results in troublesome error propagation (instability). 

The second partial derivative (@?u/0x?);, is usually replaced by the second 
difference quotient 


Ujink— aia ar O;-y =a eeu : (4.7) 
Generally, we can replace the partial derivative 
am tu AP ASU ;_1,k-s 

(Sorape) by h™ [* ? (1.8) 


in which there is a certain amount of freedom in the choice of r and s; 
m—i 


normally y (and s correspondingly) will be = or according as 


is even or odd, although when ™m is odd there is also the alternative of 
replacing 0%u/0x™ by the symmetrical expression 


1 
ay [AE (O_mon + U_ mst I: (1.9) 
2 ’ , 
Beg : 
Thus —} , for example, can be replaced either by 
ox dy /o,0 
1 
PL (61,1 — 280,1 + 8—1,1 — 1,0 + 280,0 — &—1,0) 
or by 


4 
ohL (61,1 — 285 4 1610 el al 0 te 4) 


In this way we can find a finite-difference approximation to any 
partial derivative, and hence we can set up a difference equation repre- 
senting the differential equation at each mesh point}?. 


1 A method in which only the derivatives in one fixed direction, for example, 
in the x direction or in the y direction, are replaced by difference quotients is 
given by D. R. HartREE and J. R. WomersLEY: A method for the numerical or 
mechanical solution of certain tvpes of partial differential equations. Proc. Roy. 
Soc. Lond. Ser. A 161, 353—366 (1937). Consider, for example, the problem 
ty,— Kuy with given boundary values u (4, 0), «(0, v), u(a, 9). If we use a backward 
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1.2. An example of a parabolic differential equation with given 
boundary values 
If radiation and convection are neglected, the temperature u(x, #) at time ¢ 
in a thin homogeneous rod at a distance + from one end satisfies the differential 
equation arn ren 


Oat °F Be 


(the one-dimensional heat equation), where c=go/k is a function of the density 9, 
specific heat o and thermal conductivity &. Given the initial temperature distribu- 
tion u(%,0) for O< ¥ Sa, where a is the length of the rod, and the end temperatures 
u(O, t), u(a, t) as functions of time for ¢ 20, it is required to calculate the tem- 
perature distribution «(*,?) along the rod at subsequent times (cf. Fig. IV/3). 

With y=t and h=a/n we cover the region of the (x, y) plane in 
which we are interested with the mesh defined by 


=th, Y=! (o — 01 2,-0.2, We 2s) 


Then if we use first of all the crude approximation with the forward 
difference quotient in place of the time derivative, the difference equa- 
tion corresponding to the differential equation (1.10) at the point 
(%5, Ye) is 
Ui41,e— 2U;,n+ Vi-sr 
h2 


= (eet ee (1.11) 


This has the following advantages: 


4. The mesh width 7 in the time direction can be chosen so that the 
term in U,, does not appear in the difference equation (1.11): 


Beg) GS 
i ae (1.12) 


This simplifies the calculation considerably, for U;,,, is then formed 
merely by taking the arithmetic mean of U;,,,, and U_,,: 


U; 441 = 3 (Usa + G-as)- (1.13) 


difference quotient in the y direction, the equation becomes 
( au | = K Mik Miho 
0x3 ie 1 ; 
and if the values up to the (4 — 1)-th row are already known, we have to solve a 
boundary-value problem for an ordinary differential equation to obtain the values 
u(x,k1) on the k-th row. If, on the other hand, we use finite differences in the 
direction, so that 
ou 1 a 
K (3), ae {Uj4.4— 2%:,4+ 4; 1 RY (f=1,...,n —1), 
we have to solve an initial-value problem for a system of ordinary differential 
equations of the first order. Machine methods of solution are particularly suitable 
here. 
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With a little practice this averaging 
process can be performed in the head, so 
that the successive rows can be written down 
immediately, Build-up of rounding errors 
can be inhibited effectively simply by round- 
ing to the nearest even end digit; thus, for 
example, we round 


0°43765 to 0-4376, 0:43775 to 0-4378. 


2. The difference equation (4.13) 
relates the values of U at three mesh 


Fig. I1V/3. The two interlacing sets of mesh points 


points belonging to a sub-set of the 
whole set of mesh points. There are 
two such sub-sets (see Fig. IV/3), each 
complementary to and interlacing the 
other; they consist of the mesh points 
with 1+ even and odd, respectively, 
which are marked with black and 
white spots, respectively, in Fig. IV/3. 
The calculation need only be carried 
out for one of these two sub-sets. 
Numerical example. Let one end (* = 2) 
of a rod of length 2 with the initial tem- 
perature distribution u(%,0)=0 be kept at 


this constant temperature while the tempera- 
ture at the other end (# = 0) is varied sinus- 


oidally with period { c, so that «(2, #)=0 
and u“(0,?) = sinwt, where w= =. Then 


1 c 
with h = ce the boundary temperature 1 (0, ?) 


reaches its maximum value of 1 when # = 6], 
i.e. when = 6. Thus we know the boundary 
values printed in heavy type in Table IV/1. 
We can immediately proceed to calculate the 
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values of U for one of the two sub-sets of mesh points, starting from the row 
k=0 and working downwards row by row in accordance with formula (1.13). 
Thus, for convenience, the time axis in the table points downwards, the opposite 
direction to that in Fig. IV/3. 

An important row-sum check can be derived as follows. Suppose 
that m is even, say, (asin the numerical example, where » =8) and 
consider the sub-set of mesh points for which 7+ is even. Then for 
even & we add together the equations obtained from (1.13) by putting 
4=1, 3,...,%—1 and find that 


ie 


n 
2 2 
22 Usi-s, mir = Un, 22 Cant Coes (1.14) 
a corresponding formula for odd & can be derived by adding the difference 
equations with 1=2,4,...,%—2. If we now introduce quantities S, 
and 7, defined by 


aT 


2 
S,=22 03.5 T=H.+S.4+G. 
at 


when k =2s is even and by » (1.15) 


a9 


2 
o,=U,,+U,-13, SiO, + 2 2 Urea. T,=o,4+S, 


when k=2s +41 is odd, we find that 
h.= 2s+1) Sasia = Sesta- (1.16) 


Thus the check consists in forming S, and 7, for each row and observing 
alternately whether the value of S, or J, is the same as for the previous 
tow. A simpler row-sum check is possible when the calculation is 
carried out for both sub-meshes simultaneously. 

The results obtained show that once the effect of the varying end temperature 
reaches any fixed point of the rod the temperature at that point oscillates with 
the exciting frequency but with a phase lag (more than half a wavelength near the 
end *= 2) and that the amplitude decreases towards the end *=2. For small x 
and large ¢ this behaviour is confirmed by the solution of the heat equation 


u=e—**sin(wt— ax), 


where a= |/cw/2 (see Exercise 4 in § 6.4). 


1.3. Error propagation 


Now let us try to improve upon the results obtained in § 1.2 by 
recalculating them from a formula in which the time derivative has been 
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replaced by the more accurate central! difference quotient (1.4) instead 
of the forward difference quotient. Equation (1.11) is now replaced by 


— ¢ Uinti—Uir-1 
21 , 


Ui41,2— 20; n+ U;-1% 
h2 : 


Hence with the same relation between the mesh widths / =1ch? as in 
(1.12) we have 


U; na = Uji, — 2U;, 4+ U1 t+ U,a-r- (1.17) 


With this formula we need starting values on the row t=/. We could take 
over the values already calculated in § 1.2, namely 


U1,=U,,=°9:° =U, =0, 


but since we are using a more accurate formula, we do not want to lose any accuracy 
through the propagation of errors due to poor starting values. Consequently we 


Table IV/2. Starting values for the centval-difference formula (41.17) 


1 0 0 0 

2 | 0.058144 | 0 0 

5 | 0:029072 0 0 

4 | 0-116096 0:014 536 0 

5 0:065 316 | 0°:007 268 0 

6 | 0-173648 0:036292 0-003 634 

7 9°104970 0:019963 0°001 817 
8 0°062466 | 0:010890 

9 0-036 678 


calculate the values on the row t=/ by repeating the calculation of § 1.2 with a 
finer mesh having mesh widths h’= th, l’= 121, which also satisfy the relation (1.12). 

This short initial calculation need only be taken as far as is shown in Table IV/2, 
for we only require the last value: 


a=3h’, y=9l', Us ,=0-036678. 


We then put U,,=U; 9, Uz,;= °°: = U;,,=0 and work downwards row by row 
using formula (1.17), with the results shown in Table IV/3. 


1 The third possibility, namely of using a backward difference quotient for 
the time derivative, leads to the difference equation 


O(Uj41n— 20, 44+ G12) = Gir— Ga-sa 


and is followed up by P. Laasonen: Uber eine Methode zur Lésung der Warmelei- 
tungsgleichung. Acta Math. 81, 309 —317 (1949). With this method the solutions 
of the finite-difference equations converge to the solution of the differential equa- 
tion for arbitrary, fixed o, but the calculation is complicated by the fact that one 
has to solve a system of linear equations to find the values U;, on each new row. 
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Table IV/3. Solution of the heat equation using the central-difference formula (1.17) 


4 ]0°25882| 0:036638 0 0 

2 [0°5 0:18548 0-03668 0 

3 |0-70711| 0:20244 0:11210 0:03668 
4 |0°86603|) 0:59979 0:05160 0:03874 
5 ]0:96593 |—0:07951 064743 0:04748 
6 1 2°37217 —1°27529 0:55659 
7 10:96593 |—5:09914 6:12677 —2:150914 


0 0 0 GO Ho 

0 0 0 0 ) 

0 0 0 0 0 
0:03668, 0 0 0 0 
—0-03462| 0:03668 0 Ome 20 
0:19008|—0:10798 0-:03668 o |0 
0:03383, 0:47940—0:18134 0-:03668 0 


Just these few rows show already that the calculation is quite 


useless. If we proceed any further, we obtain numbers with alternating 


signs and assorted magnitudes which bear no relation whatsoever to 
the solution of the problem. This is caused by a rapid build-up of 


Table IV/4. Propagation table for the difference equation (1.17) 


41 | % Xi+4 

i) 0 € 0 0 0 

(0) € —2€ € 10) 0 

€ —4e 7€ —4e E 0 

—6E i7€ —24¢€ 47 € —66é € 
31 € —68 6 89 € — 68 € 31 ¢€ —8eE 
—144¢€ 273 € | —338e 273€ —144e 49 € 
64146 —1096¢e 13114 e | —1096¢e 641e —260€ 


errors, which is a characteristic of formula (1.17). We can analyse such 
a build-up of errors by assuming that, besides the error already present 
due to the finite-difference approximation, an additional error ¢ is made 


at some stage in the calculation, say at (.x,, ¥,). 


The propagation of 


this error is easily traced by repeated application of (41.17); thus on the 


next row y = ¥,41 it causes additional errors ¢, —2¢, e at ¥=4x,;_,, x 


1? 


%;11, Which in turn cause additional errors «, —4¢8, 7&, —4e, & at 


X==Xj 9) a5 


., X49 On the next row, and so on. These additional errors 


arising from the single error ¢ can be tabulated in a “propagation table’”’ 
as in Table IV/4. 

Examination of the numbers in the table reveals that the error grows 
approximately by a factor of four from row to row. Even if the calcu- 


lation were carried out with so many guarding figures 
gation of rounding errors could not affect the result, 
truncation errors which are inherent in the use of the 


that the propa- 
the intrinsic or 
finite-difference 
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approximations would increase so rapidly in consequence of the unstable 
character of the difference equation (1.17) that the method would still 
be quite useless. It could be argued that the presence of the boundaries 
inhibits the growth of the error, but if we form the propagation table 
for a single error e« in a boundary value, due to rounding say, we see 


Table IV/5. Propagation of an error on the boundary 


€ (9) 0 10) (8) 0 
(0) € 0 0 (@) 0 
0 —2€E é 0 (8) 0 
0 66 —4e € (0) (0) 
(a) | —18 16¢ —6eE € 0 
o | 586 —60¢e 30e€ —8e é 
O | —194e 2246 -—134e 486 —106 


(Table IV/5) that there is no appreciable reduction in the growth of the 
error, the effect of the boundaries amounting chiefly to a delay of about 
one row. 

In contrast, the propagation table for the difference equation (1.13) 
(Table 1V/6) shows no build-up from an error ¢ introduced at any point; 
in fact the propagated errors gradually decrease in magnitude. 


Table IV/6. Stable propagation table for U; ,44= . (U;41,4 + U;_s x) 


| 


| 


0 é 0 
0 OSeE O-Se 0 
0-25 € OSe O25 € 
0°125 € 0:375 € | O°375€ 0°125 € 
0-25 | Orsi 6 0-25 € 
015625 € 0°3125 € | 073125 € 0°15625 € 
0°3125 € 


Summary!. If we replace the time derivative in the heat equation 
by the (crude) forward difference quotient and take / = }ch?, we obtain 
formula (1.13), whose propagation table shows a gradual decrease in 
the magnitude of the propagated errors, and the calculation proceeds 
smoothly (that this method is usable is assured by a convergence proof 
in § 3.3); if, on the other hand, we replace the time derivative by the 
central difference quotient, which in itself is more accurate, and use 
the same mesh relation /=ich?, we obtain the formula (1.17), whose 
propagation table shows a rapid increase in the magnitude of the 
propagated errors and which is therefore unusable (“‘unstable’’). 


1 The question of error propagation is discussed further in § 3.4. 
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1.4. Error propagation and the treatment of boundary conditions 


In many applications we are not given the boundary values of w 
itself; often it is the normal derivative of # or a combination of # and 
its normal derivative which is specified on the boundary. These types 
of boundary condition can be dealt with in various ways, which we will 
now illustrate by an example. 

A physical problem. Consider an electromagnet whese vere is a selid metal 
cylinder of specific resistance o and permeability w. The eddy-current density + 

r and the magnetic field strength H directed along 
the axis satisfy the equations?! 


C > (rei) +H " 
@a re) ny «igs (ts 


where r is the usual cylindrical co-ordinate. Elimi- 
nation of 7 yields a second-order parabolic differen- 
tial equation for H: 


eH , or eH 
ort rr 6 @ 


(1.19) 


| 
It remains to specify some initial conditions. 
Fig. 1V.4. Eddy currents in a metal Let a constant electromotive force # be suddeniv 
cylinder switched into the windings circuit at time ¢=0, 
there being no current in the coil and no magnetic 
field in the core before this time (Fig. 1V 4). The subsequent eddv-current density 
j and magnetic field strength H are to be calculated as functions of r and ?¢. 
If the core is of radius r, and length / and the coil has N uniform windings 
of ohmic resistance R, the boundary conditions? can be written 


=0: H=0 for OSrsyr,, 


y=7: H+ pt ate for t>0, 


(1.20) 
oH @H 
%=102 2a, ——, —-.- continuous, 
er ér? ‘ 
where 
Ri : 2wN, @ 
> > = 
eS aen' Ri 
1 Wacner, K. W.: Operatorenrechnung, 2nd ed., p. 230 et seq. Leipzig 1950. 
The equations (1.18) follow from the field equations curl Ho gas. weurl: u wr 
g 


(H is the magnetic field strength, ) the current veeter) by making use ot the axial 
symmetry. 

2 If U is the induced back e.m.f. in the windings, the effective e.m.f. is E + U, 
which must be equal to the potential drop across the windings: E+ U=RI. 
Now U can be calculated from the electric field strength at the surtaee of the cove 
and hence expressed in terms of the eddy-current densitv: Uo« 2a @ Ney). 
Further, the line integral of the magnetic tield strength vields J#(0,) e4a NTU. 
Elimination of U, J and /(7,) from these three equations togethet with (ft 18) leads 
to the boundary condition of (1.20) at», (ef. K. W. Waser: see last footnote), 
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Por ar warserical example we consider the case B= 4r,. With the 
dimensionless variables 


7 Li ot a 
t-— => — -—_ => —_ 
s’ y 4nprt’ ig E ” 
(1.19) becomes?! 
Pu si ou — ou 
oat 4% On By’ (1.24) 


and if the range of the mew variable x is extended to cover the whole 
2zial wertion, the boundary conditions can be put in the form 


y=0: “=0 for —1S5%*S1, 


Ou 2 
=0: 4 =, ?* continuous, 
(point of symmetry) Gx ox 
3 4.22 

x=1: fee Bhi. (1.22) 
2 Ox 

x= — 4: —_. 
2 Oz 


The last condition may be omitted if we use the symmetry about x =0 
and restrict ourselves to the interval OS x31. 

Again we employ a mesh 1.1) with yy=0 and 2/=h?, as in (1.12); 
and, after our experience in § 1.3, we replace the derivative in the time 

P ou . : + r 
direction val) d by the forward difference quotient i, eg — Gag 
The difference equation does not depend so critically on the radial 
derivative rr, ; and we therefore replace this derivative by the 
Jt," 

central difference quotient si (Oy ,—-U, 14). The resulting difference 


1 reetnod wmck mm ramch used, particularly by electrical engineers, for the 


aitlerential equations (mostly with constant coefficents and infimte fundamental 
reyiony, 14 the operational method using the Laplace transformation; see, for 
exarapie, G Dortsew: Theore und Anwendung der Laplace-Transformation. 


yee 1937, 496 pp. Yabelien zur Laplace-Transformation und Anleitung zum 
Cepunmeh berlin and Gotungen 1947, 145 pp. — Cmuurcuite, R. V.: Modern 


Operational mathematics in engineering New York and London 1944, 306 pp. — 
Waowpe, KW: Operatorenrechnung und Laplacesche Transformation nebst An- 
wendung in Pivnk und Techmk, 2nd ed. Laypzig 1950, 449 pp. — Carstaw, H.S, 
and J © Jarorne: Conduction of heat in selids. Oxford 194%, 346 pp., here in 
particular pp. 239—290, 320— 338. 

from a nurseneal pomt of view (for problerns not soluble in closed form) the 
Lajlace transform method is only suitable for a restricted range of problems. For 
sore: probleme it leads to results which can be obtamed just as well by other means 
and for others to senes expansions whose numerical evaluation is often merely 
tedious. Future developments wail show whether or not the frequently expressed 
hopes of the Laplace transform are justified. 

Another method for the solution of similar problems is the “mixed"’ Katz 
method, see Ch. V, § 5.9. 

Collatz, Numerical treatment, 3rd edit., znd print. 48 
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equation reads 


1 
U. = 
t,k+1 2 


(Uj43,4 + G-a,) + q (U.44.2— Gj-1,2)- (1.23) 


The boundary conditions can be taken into account in several ways: 

4. Choose a mesh with the boundary x =1 as a mesh line, say x¥ = x,, 
and replace the derivative in the boundary condition by the backward 
difference quotient. This gives the ‘‘finite’’ boundary condition 


Uk or x (Ons —_ Oey) ae 
so that 
ay (1.24) 


2. Again choose a mesh with x, =1 but replace the boundary deriva- 
tive by the central difference quotient. This entails keeping a column 


Table IV/7. Propagation tables for various boundary formulae at x= 1 


Formula (1.24) Formula (1.25) Formula (1.26) 


r=§$ 2=$) 2=% 


0) . € 


O 0:625¢€10:375e) O 0:625€ — 0-788 | 1-662e] 0 0-625! 0-268 € 
0°469 € 0:234e| 0'141e]0:-469e —0-486e| 1:2296 | —2:125¢ f0-469e 0-167€ 0-072€ 


of values of U,,,,. If the k-th row is completed, U, ,,, is calculated 
from (1.23) with «=n, then U,,,,,, is calculated from the “‘finite” 
boundary condition 


11 
Unga = on (Oy41,n+1 — Spang) = 1, 


which is used in the form 


Oya, ata = 4h (1 — Uy nya) + Up-1, n4r- (1.25) 


3. Choose a mesh for which the boundary x = 1 lies halfway between 
two mesh lines, say += x, and #=w,,,, and use @(U, , +9U,,., ,)#as 
the approximation for wu at x=1. Replacing éu/¢x in the boundary 
condition by the central difference quotient we find that U,,, , is given 
by 

Uo pet 
n-t 1,k 4 ae h = 

The propagation table for a boundary error depends on which of 

these methods we adopt. Table IV/7 shows the results of using (1.24) 
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and (1.25) with h=4 and (1.26) with h=2 [the corresponding homo- 
geneous equations must be used in deriving the error propagation; for 
example, (1.25) must be used without the term 4/ x1 on the right-hand 
side}. It can be seen that (1.25) compares unfavourably with the crude 
approximation represented by (1.24). In fact, if we try to calculate the 
solution using (1.25), the increasing randomness of the results (see 
Table IV/8) soon convinces us that the use of this apparently reasonable 


Table IV/3. Invalid calculation using the boundary formula (1.25) 


2 ) 0 i) 0:7778 | 0-2963 
3 i) ) 0-4861 0-1728 | 1-5890 
4 0:3646 00907 11295 | —0-0820 
5 0:8427  —0-0100 2:1893 


method of dealing with the boundary condition has rendered the calcu- 
lation quite useless. Of the other two methods (1.24) and (1.26), the 
latter has the advantage of the accuracy of the central difference 
quotient. 


The other boundary x =0 can also be dealt with in various ways: 
1. Using a mesh with x=0 as a mesh line. Since 


lim 
z—>0 * x0 1 


(1.27) 


aulax _ ulox* a u \ 
—-— = lim ——— = (F),-0 x 


the differential equation (1.21) becomes 


ui Ou 
ax? Oy 


as x >0. We now require a corresponding difference equation which does not lead 
to instability. From our experience in § 1.3 we try replacing (Gu/dy),), by the 


forward difference quotient 4 (Uy e-1— U,x), but find that the difference equation 


so obtained, namely 
Up, rti= 2U,,4—Un,n (1.28) 


(in which we have used the symmetry U,,— U , 4), propagates a boundary error 
with increasing magnitude (see Table 1V/9). It turns out that the backward dif- 


ference quotient i (Uy »— Uy p—-1) is the best to use here, as can be seen from 


the propagation table (Table IV/y) for the resulting difference equation 


Up, r= 3 (2U,, 4+ Uy, e-2)- (1.29) 
2. Using a mesh such that the boundary *— 0 lies halfway between the two 
mesh lines x = — 4A and x = + 3h. With such a mesh we do not need any special 


18* 
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Table IV/9. Propagation tables for boundary formulae at x =0 


Formula (1.28) 


Formula (1.29) 


boundary equations, we merely simplify the difference equation (1.23) by utilizing 
the symmetry about x= 0. This is in fact the method we adopt in the calculation 
below (Table IV/10) with 4 =. 

Having decided on the best equations to use, we can proceed to calculate 
U;, tow by row from (1.23) for += 1, 2,...,%—4 and from (1.26) for <=n. 


Table IV/10. Valid calculation of the growth of a magnetic field in a metal cylinder 


Row-sum check 

4 ; 4°8 

2 tt) 0:228 5710-53714} 8-50281 | —0-00007 
3 013744 |0-30694 |0:58416] 11-82948| + 05 
4 | 0-425 0 0:091 43 |0°184 16 |0-39258 |0°63555 | 14°74509 | + of 
5 0091 43 |0:12277 |0:27212 |0:44210 | 0-665 26 | 17-42304 | + 03 
6 0°12277 |0:21189 |0°31437 |0°49677 |0:69806 | 19°83852 | — 04 
7 0:21189 |0°25050 | 0-38282 |0-533 62 |0:72017 | 2207709 | — 07 
8 | 0-250 }0:25050 | 0-325 84 |0-42037 |0°575 59 |0°74535 | 24-11412 | — iV 
9 0:32584 |0:36375 |0-47569 |0-60607 |0:76364 | 26-00493 | — 07 
10 0°363 75 |0°425 74 |0°509 14 |0°64023 |0°78414 | 27°:73176| — 05 
11 0°425 74 |0:46068 |0:554.43 |0°666 28 |0:79977 | 29°33355 | — 05 


These equations are best written out explicitly. For h= + they read 


U, = Ug, Ug F(u, + 2uy), y= § (Zug + 34), Uy =F (3g + 45), = F(2+ 3%), 


where we have used the more concise notation u,; for U;, and u; for U; x41. The 
coefficients can be conveniently recorded at the heads of the columns as in 
Table IV/10. 
As a row-sum check we can form 
On = 3 (Uy + 3g t+ Sug t+ 3% + 405) 
and 
On = On— Oh—-1 — 8(1 — 4p) 
and check that o, vanishes. 
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1.5. Hyperbolic differential equations 


Using a rectangular mesh (1.1) and the approximations (1.4), (1.6) 
we can represent the differential equation 


GE (i ) 
ate ae, dee = Sesh tfuar, (1.30) 


where a,c, d,e,/,7 are given functions of x and y with a>0, c<0O, by 
the difference equation 


a, Ursa, na at U-ap Bez U44, feats Be 
(1.34) 
aie, eae 2 Cast Tbe i a et f= 1:4. 
For the wave equation 
Ou 4 Ou 
OE ak Oye 2) 
and with the mesh relation 
h=ol (1.33) 
this difference equation simplifies to 
Uy; eta = Ujsan+ G14 — Gi a-1- (1.34) 


We now consider some examples of the various types of initial- and 
boundary-value problems which can arise. 


1. Values of « and @u/dy specified on the whole x axis: 
“= G(x), je = H(x) for —o<%<+o00, y=0. (1.35) 


In this case we know immediately the values U; »=G(ih) [for a mesh 
(1.4) with x) = yp=0]; we can calculate the values U; , on the neighbour- 
ing row k=14 as follows. Write (1.31) for k=O in the form 


fi eo ; fio 0) __ y* 
U, (4 + So) + U, -1(4¢ — 0) = 28, (1.36) 
where the 7* are known and given by 
r* = — a;, U;41,0—- 2G,0+ U-1,0 _ — als 


12 : 2h 
+269 — ae —f0U,0+ Vio 
from the boundary condition 0u/0y = H(x) we have 
U,,—U, 1 = 21H (th); (1.37) 


1, 
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then elimination of U, _, between (1.36) and (1.37) yields 


: Os (hs cee 
U, = 1 H(i) [1 — 5] +52. (1.38) 


We now have starting values for the difference equation (1.31), by 
means of which we can calculate successively the remaining values of 
U; ,, for R= 2,35 yee 

2. Values of u specified on the boundary shown in Fig. IV/5 
as a heavy line and values of @u/@y specified on the part of that 
boundary which lies along the x axis: 


y u = G(x) | 
Ou for asx, 
ay y=0, 
m= mt u = 9(y) for — 4 (1.39) 
= 3 y>0, 


y>0 
a (fe Dek For a mesh (1.4) with 
dy 
Fig. IV/5. Boundary cf the solution domai = a _ b-4 
_ (ee feeble (1.30), (1.39) - X= 4, vo 0, h= 5 


n 


where is an integer greater than one, we know the U, , at the boundary 
points (‘white points” in the figure) and can calculate the values U; 1 
(at the ‘‘black points” in the figure) from (1.38). The remaining points 
are dealt with using (1.31). 

3. Other types of boundary conditions often occur in applications; 
for example, we could have 


au + we (y) for =a, y>0 


instead of «= (y) as in 2. Boundary conditions of this kind can be 
treated by the methods of § 1.4. 


1.6. A numerical example 
A uniform circular membrane of radius a@ is fixed rigidly around its circum- 
ference and is deformed! into a position defined by the displacement 


g(r) =19(1 om on 


a 


where + is the distance from the centre in the mean plane of the membrane and vy 
is a constant (the maximum displacement of the centre of the membrane). When 


1 Cf. K. W. WaGNER: Operatorenrechnung, 2nd ed., p. 243. Leipzig 1950. 
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the membrane is released (at time t= 0), vibrations are set up. The displacement 
v(r,t) at subsequent times is to be calculated. It satisfies the well-known wave 
equation, which we write down directly in polar co-ordinates: 


4 o@ oz 2 
ae ncaa ee (1.40) 


c2 Ot er Y Or co ar 
The constant c denotes the wave velocity. 
In the dimensionless co-ordinates 


a a ee Y _ ct 
gis ag ee 
(1.40) reads 
Ou 1 Ou au 
at Gar oe ee 
and the boundary conditions become 
0 
u(x, 0) =1— 23, =0 on y=0, || 1 (initial conditions), 


“%=0 (no displacement) on »=+1, y>O (the fixed boundary). 


The symmetry about the y axis allows us to restrict the calculation to the 
half region with  =0. Then for a square mesh with h =/ = + we know the boundary 
values printed in heavy type in Table 1V/12 and can proceed using the equations 


1 1 
Ur= 3 Usro(t +3 nts U;_ “ih - 3), 


4 1.42 
Uj; eta = Gis, (1+ 2 3i) + B=, a(t — 35) — yas ( ) 


4 
(C=, away — 13 Te ooalle 


These suffice until we come to deal with 
values on the y axis; these require special 
treatment because of the singularity at x = 0, 
or i=0. At this point the differential equa- 
tion (1.41) becomes 


eu eu 

Ox? ay? 
on account of (1.27), and the corresponding 
difference equation reads 


Oy rtr = 2(G,4— Gan + U-1,8) — Gai (1.43) 


However, this formula has a very unfavourable propagation table (see Table 1V/11) 
and in fact an attempt at using it yields quite useless results after a few rows. 

The simplest way of getting over this difficulty is not to use the differential 
equation at all, but to put a parabola through the points with i= +1, +2 and 
use its value at 1=0 for U, ,: 


Table IV/11. Propagation table 
for (1.43) 


1 : 
Ee — 1h i Pelamcati, (1, 9 allay 


Les) 


The last two columns in Table IV/12 provide a simple check which 
can be applied after each row has been completed. We calculate the 
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Table IV/12. Finite-difference approximation for the vibrations of a circular membrane 


B.=2-33333| f,—2-125 | B,=1-16667 
==—— a Row-sum check 
0-96 0-84 0-64 0-36 0 
o2 | 1] 0-92 0:88 0-76 0°56 0-28 | 0 | 2-48 
04 | 2] 068 0°64 0-52 0-32 0:13 0 | 1-64 
06 | 3 | 0-28 0°24 0-12 0-025 0 0 0-385 
0-8 | 4 |—0-32375;—0-32 |—0-30875'—0:220 |—0-10813) 0 —0:95688 
1 5 | —0-941 67| — 0-865 00) — 0-635 00) —0-408 44; —0-19250 0 —2:10094 
6 | —1-187 60] — 1-103 34] —0°85055| —0-533 74; —0:24926| 0 |—4-83092| —2-73689 
7 | —1:05295) — 1-004 63] —0-85968] —0-591 15! —0-27452| 0 |—4-86233 —2-72998 
8 | —0-736 26] —0-71266] — 0-641 86] —0-50293] —0-26800| 0 |—3-78169] —2:12545 
9 | —0:333 89| —0-326 29} — 0-303 48] —0:25640| —0-16554| 0 |—1-85776| —1-05171 
2 10 }+0-09514| 0:09049} 0:07664] 0:05690; 0-04365| 0 | 0:46609 0:26768 
44 | 050425] 0:48884| 0:44247| 0:37119| 0-21533| 0 | 2:69116| 41-51780 
12 | 0°84913] 0-82534| 0:75396| 0°56304; 0:28114, 0 | 4:32727| 2-42348 
13 | 112882} 1-06670| 0.88034) 0°58511| 0-27733| 0 | 4:98547| 2-80948 
14 | 1:15362) 1:05958] 0°77745| 0-49413] 0-23083| 0 | 4-50487| 2:56199 
4 15 | 0:72438| 067629] 0°53201| 0-33206, 015503) 0 | 1-69539 
quantities rae ae 
G;, =D BU,» % = 2, Us 
where = a 
pay o =o = i = 
b= = Piz 2s for 4 = 2, 3. 9 2 
4 
Baer = 1 a 2 
and check that i 
Tp — Op — Tee (Rises <<) 


The numbers £; and the coefficients (1 _ a and (1 + =| in (4.42) 


may be recorded conveniently at the heads of the appropriate columns. 


1.7. Graphical treatment of parabolic differential equations by the 
finite-difference method 


It is often convenient to apply the ordinary finite-difference method 
in graphical form!. For instance, the process of forming mean values 


1 Although it is not intended that this book should also cover graphical methods, 
we give here a brief description of this method for parabolic equations because 
of the many applications. 
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in the treatment of the heat equation 


C24" eu 
ee By (1.44) 


by the difference equation (1.13) is very easily performed graphically. 
The approximations U, , are plotted against x, the points with equal k 
defining a sequence of polygons. 
The (& + 1)-th polygon is formed 
from the k-th by joining alter- 
nate points of the latter and 
taking the midpoints of these 
joins, i.e. the points of intersec- 
tion with the ordinate lines, as 
the vertices of the next polygon 
(see Fig. IV/6)1. 


This construction is applied to an ee ea Ty47 xz 
example in Fig. IV/7; the specific Fig. Iv/6. Graphical construction for the solution of 
boundary values chosen are the heat equation 


u(#,0)=0 for —1S*S1, 
(4.45) 
u(i,t)=u(—1,f)=1—e ©, 
which correspond to a rod being heated from zero temperature by the application 
of heat to its ends so that their common temperature rises exponentially to the 
value 1. The graphical solution is carried out with h=# and therefore 1=c/50 
in accordance with (1.12). Only the region 720 is considered on account of 
symmetry; only the construction lines are shown in Fig. 1V/7 since the sides 
of the polygons, which are shown in Fig. IV/6, would have confused the picture. 
The values of k are marked at various points; the corresponding time can be 
calculated from t= &l. 
If we choose a mesh with 2/ =c,h?=c(y,)h?, the more general dif- 


ferential equation 


Cru Cu —_ Cu 
ee Oy Be, bake.) +O (may) + (1.46) 


is represented by the difference equation 
hf; 
Ci > (1 al af Ustajet 


hf; h? 
+ > (t — hs OS toe a (iat b:4 U;, x) - 


(1.47) 


We can still utilize the chord construction but here we use the ordinate 
cut off on the line x =é, ,=%;+}/?/,,, instead of the line x = x; (see 


1 ScumipT, E.: Einfiihrung in die technische Thermodynamik, 2nd ed., p. 282. 
Berlin 1944. 
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Fig. IV/8). This ordinate is $(1+$4f; .) Us1,+3(1—f/4;,4) G_x2; we 
can obtain U,,,, from it by laying off $h?(a;,+0;,U,,). The con- 
struction is particularly simple when /(x, y) depends only upon x, for 


Fig. 1V/7, Graphical solution for the varying temperature distribution in a heated rod 


then one set of lines x —é; can be used for all k. The variable quantity 
c(y) does not come into the construction but is needed when we want 
to find the value of y=, corresponding to a particular value of &. 
This is given by 


Fig. IV/9 shows the construction for the example (1.21), (1.22) of § 1.4, which 
concerned the eddy currents in the metal core of an electromagnet. The special 
construction for the boundary conditions is described in the next paragraph. 

If the values of uw are prescribed at a boundary, say *=«, then a mesh is chosen 
with *=a as a mesh line. On the other hand, if the boundary condition at =a 
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Uitnk 


> 


a Tj bin Zier x 


Fig. IV/8. Graphical construction for the more general differential equation (1.46) 


Mesh widths hm 4, dag 


| Sample values{ u(0 5) ~067 
l Ae | reado |u(1t) +066 


s 
ef fe 
bo 
Dey 

= 
Ge}he f 

= 
=) 


eo a —_—P 
Fig. IV/9. Graphical calculation of the growth of a magnetic field in a metal cylinder 
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is of the form 


u + Aly) S* = Biy) (1.48) 


with A(y)=+ 0, then a mesh is chosen so that =« lies halfway between the two 
mesh lines ¥=%, and #=4%4,, ie. so that a=3(%,+ 443); one can then 

P replace the x derivative by the central 
] difference quotient, as in (1.26), which 
yields 


Un+1,k 
? _ 2Bh+(24—A)U,, ¢ (1-49) 
x 24 +h 
a 
ty 2 @ae7 zg This equation implies that the point P 
Fig. 1V/10. Graphical representation of a boundary with co-ordinates (a +4, B) is»col- 
condition involving a normal derivative linear with the points (%,, U, ,) and 


(4n41> Uj42,4), as in Fig. IV/10; 
hence, knowing U,,, we can construct U,,,,;. If A and B do not depend 
on y, P is the same point for all & (as for the example in Fig. IV/9). 

If 4 does not occur in the boundary condition (1.48), ie. @u/0* is prescribed, 
then U,41, can be constructed from U, ,k merely by drawing a line in the specified 
direction. 


1,8. The two-dimensional heat equation 


When we consider the equation of heat flow in two dimensions 


Ou Oui soo 

dat | ayo Ge (ae) 
we find that an approximate finite-difference solution can still be ob- 
tained by an averaging procedure and hence by a simple graphical 
construction on a plane projection of the (x, y, ~) space. 


We use a three-dimensional mesh 


%=X+th, 
Y=Vtkh, (t,k,2 =0, +1, +2,...) (4.54) 
2=2, +h, 


with mesh widths 
h,=h,=h, h=cohk. (4.52) 


The corresponding “forward” difference equation reads 
Ui et =0(Gar 2+ Gr.:+U, Larait Up xy )+ 
+ (146) Uy 
With 9 = %, the value used in (1.13), we have the formula! 


Uniti a — Uae (1.54) 
1 Erser, K.: Schweizer Arch. Angew. Wiss. Techn. 10, 341—343 (1944). 


(4.53) 
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where 


S= Vee Cpa 


4.55 
+ U, psa ait a co) 


Its error propagation, shown in 
the sequence of tables above, 
renders it practically useless; an 
error € is approximately doubled 
at each step in the z direction. 


yz, x, led 
8 (Md-point of AB) 


u 


However, putting o@=j in 
(4.53) yields a usable formula! 
which is also very simple: 


Fig. IV/11. Graphical construction for two-dimen- 


Ue t44 = iS, (1.56) sional heat flow 


where S is as defined in (1.55). The graphical construction for this 
formula is shown in Fig. IV/11 and a numerical example is given in 
Exercise 6 in § 6.4. 


1 Mentioned briefly by K. ELsER: see last footnote. 
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1.9. An indication of further problems 


The finite-difference method has been applied with success to many complicated 
hydrodynamic and aerodynamic problems but to go into details here would be 
beyond the scope of this book. Suffice it to mention (in addition to the references 
given in § 5) the application of the finite-difference method to the systems of 
partial differential equations arising in fluid dynamics! and to boundary-value 
problems for differential equations of “‘mixed type’’, i.e. equations which are 
partly elliptic and partly hyperbolic in the considered region, there being a dividing 
curve along which the equation is parabolic. These 
latter problems are important in gas dynamics? (the 
dividing curve corresponds to the transonic region) ; 
their numerical solution needs to be treated with 
particular care and attention. 

As an example which can be formulated very 
simply (this problem has been treated theoretically) 
consider the differential equation 


— Uy, t+f(%) uyy=0, (1.57) 


Fig. I1V/12. A boundary-value Where /(*) is a non-decreasing function of x with the 

problem for a differentialequation same sign as x. Then (1.57) is elliptic for x<0, 

CheiineltyEes parabolic on the line x = 0, and hyperbolic for x > 0. 

Let the boundary J’ consist of an arc E in the half- 

plane x0 which has only its end-points R and P, in common with the y axis, 

together with the two characteristics C, and C, which proceed from R and P,, 

respectively, into the half-plane +20 (Fig. 1V/12). Let u be prescribed on the 

boundaries E and C,. Then u is determined uniquely inside J’, and it should 
be possible to calculate « numerically. 


§2. Refinements of the finite-difference method 


The finite-difference method can be refined in exactly the same ways for partial 
differential equations as for ordinary differential equations (Chapter III, § 2). 


1 Ways of overcoming difficulties occasioned by the presence of singularities 
on the boundary are given by H. GorrrerR: Ein Differenzenverfahren zur Berech- 
nung laminarer Grenzschichten. Ing.-Arch. 16, 173—187 (1948). — Wiuttina, H.: 
Verbesserungen des Differenzenverfahrens von H. Gértler zur Berechnung laminarer 
Grenzschichten. Z. Angew. Math. Phys. 4, 376—397 (1953). 

* The literature on the subject of differential equations of mixed type began 
with the pioneering work of F. TRicomi: Sulle equazioni lineari alle derivate 
parziali di 2° ordino di tipo misto. Mem. Real. Accad. Lincei 14, 133—247 (1923). 
It has expanded so rapidly in recent years that we will content ourselves here 
with mentioning a few arbitrarily selected papers: PRoTTER, M. H.: A boundary 
value problem for an equation of mixed type. Trans. Amer. Math. Soc. 71, 4146—420 
(1951). — Brreman, St.: On solutions of linear partial differential equations of 
mixed type. Amer. J. Math. 74, 444—474 (1952). — Hexiwic, G:: Anfangs- und 
Randwertprobleme bei partiellen Differentialgleichungen von wechselndem Typus 
auf den Randern. Math. Z. 58, 337—357 (1953). — Lax, P. D.: Weak Solutions 
of Nonlinear Hyperbolic Equations and their Numerical Computation. Comm. 
Pure Appl. Math. 7, 159—193 (1954). 


2.1. The derivation of finite equations ° 287 


2.1. The derivation of finite equations 


To simplify the description we limit ourselves to linear partial dif- 
ferential equations in two independent variables, x, y. Such an equa- 
tion of the m-th order can be written 


q 
Ew] = > A,,(2, ) Ze = 42,9), (2.1) 
pb+qsm 
where the A,,(x, y) and r(x, y) are given functions which we shall 
assume to be continuous. Let sufficient starting data be given, say on 
the x axis and certain boundary curves, to determine uniquely a specific 
solution «(%, v). It is required to calculate the approximations U, ,,1 
on the (k+1)-th row when the calculation based on the rectangular 
mesh (1.1) has progressed as far as the k-th row. For this purpose we 
derive a finite equation 


2C,U, ti (2.2) 


corresponding to (2.1) at ee Yo), In which the coefficients C,, are 
determined so that the Taylor expansion of the sum 


© — DC tin (2.3) 


in terms of u and its partial disie estes at the mesh point (tp, %) agrees 
with (2.1) at (x9, ¥9) to as high an order as possible, i.e. so that the 
order of the lowest derivative in the Taylor expansion which does not 
have the same coefficient as in (2.1) is as high as possible. The sum- 
mation in (2.2) and (2.3) is to extend over a number of mesh points 
in the neighbourhood of (9), %) the choice of which depends on the 
given differential equation. The number of points may be greater than 
is absolutely necessary for the Taylor expansion to coincide with the 
differential equation to some order; for then we have certain free or 
“surplus” C,, at our disposal, which can be chosen so as to make the 
finite equations as stable as possible. A rough indication of the stability 
is given by the “index” J, which we now define. 
Normally we will use a finite equation (2.2) which, besides the term 
U, 41 to be calculated, involves only values Uy, with@egk. If it is 
written in the form 
OU 4 = See, she a tia, Me? (2.4) 


Cy k+1 


which expresses U;,;, in terms of the remaining U,,,, its index J is 
defined as the sum of the absolute values of the ogg tliat of the 


remaining U, ,: 
_ aed ee . (2.5) 


Ci, +1 
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Apart from the restriction x<k, the summation is over all ¢,x for 
which C, , = 0. 

We try to keep the index J as small as possible; this can often be 
done by suitably choosing surplus coefficients C 4x» aS Suggested above, 
and also by moving the ‘‘centre’’ (t),%)) of the Taylor expansion 
“forwards”, i.e. by choosing it near the point (7, k +1). 

When certain other conditions are satisfied, the condition J<1 is 
sufficient for the stability and convergence of the finite-difference 
method, see §§ 3.3, 3.4; however, formulae with a greater index can 
still be usable, for instance, J =3 for equation (1.34). 


2.2. Application to the heat equation 


To illustrate the derivation of finite equations, let us follow through 
the procedure for the inhomogeneous heat equation 


L[u] =—K5* 4 24 =7(x,y). (2.6) 


For simplicity we take the origin of the mesh co-ordinates at the 
mesh point (7,k-+4) and use this point as the centre of the Taylor 
expansion; thus tj=%,—0. We extend the 
summation (2.3) over the points (1, x) with 
|+|S2,%=—1,x=—2 and 1=0, x=—3 
and denote the coefficients C,, by a, b, 
c,d,e,f,g,7 as indicated in Fig. IV/13, 
taking advantage of symmetry (thus 
Co o=4, Cy, 4=C4,1=¢, etc.). Each u, , 
has now to be expanded as a Taylor series 


Fig. I[V/13. Notation used in setting up : : 
a finite expression for the heat equation centred on the point (0, 0) , for example, 


re . 
My, -1 = Moo thts 9,9 —1 Uy 99+ = eng * (2.7) 


By similarly expanding all the terms which appear in the sum (2.3) 
we obtain 


D=ula+b+2c+ 2d +e+27+2g¢+7) + 
-+ luy(—b — 2c — 2d — 2e — 4f — 4g — 34) + 
+ uy 420+ 8d + 2f + 8g) + 


+ u,b +26 + 2d + 4e + 8f + 8g +94) + 


+ A tgsy(— 20 — 8d — 4f — 162) + 


fe . 2.8 
TS Uyyy(— 6 — 2¢ — 2d — 8e — 16f — 16g — 277) + pe 
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+ eere(20 + 32d + 2f +328) + 
+ teryy (26 + 8d + 8f + 328) + 
+ tyyyy(b + 26 + 2d + 16¢ + 32f + 32g + 817) + 


-+ terms of the 5th order, 


in which all the 4, u,, etc. are evaluated at the point (0, 0). 


This expansion is to coincide with the differential expression (2.6) 
to as high an order as possible, so the second bracketed factor must 
have the value — K//, and the third must have the value 2/h?, while the 
first, fourth, and as many more as possible, must be zero. For comparison 
we complete the derivation for formulae correct to several different 
orders. 


1. First-order formulae. Here we equate coefficients of u, u,, u,, 
only. This requires three constants, say a, b,c, and from the equations 


a+b+2c=0, 
K 
2 
2 7 
their values must be 
ee ee 
ieee as peak” ~ Re 
With the notation 
1 
° ae 
we have 
K 
ore (— Ug ot (1 — 20) Up 1+ O (Uy Brig t4_1 -1)) 28) 
= (— K i + a F + remainder term of the 2nd order. 
¥y x” 10, 


The finite equation obtained by neglecting the remainder term reads 
[when expressed in the form (2.4) ] 


U),0 = (1 — 20) Up, act a (U,, Sails Uy, ei ahr 9, (2.10) 


which is the formula for the ordinary finite-difference method. 

o is positive, and for all values up to a half the index for equation 
(2.10) is 1; for o> the index is always greater than 1. In this respect, 
equation (2.10) is equally favourable for all values of o in OSe5 f; 
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however, the formula obtained by putting o=}, i.e. 
Oh, = 4(U, ag U_, ot s 2177 0; 


is more advantageous than a formula resulting from a smaller value 
of o, say o=4, which gives 


Uso = 3 (Uy, Ae U,, ao Os 2) ee 70,0» 


because a greater value of o means a greater value of / and hence we 
progress further in the time direction with the same number of computed 
values. 

2. Second-order formulae. When we try to equate coefficients of 
all terms of up to the second order inclusive, we see immediately that 
this cannot be done with the constants a, b, c, d, since the four equations 
are then inconsistent. With the four constants a, b, c, e the equations are 


gb oc He 0 bee — se 


i 
2c= =, b+2c+4e=0, 


and these can be soived; they yield 
ee me Soames at ee 
2k a ee 
With these values we have 


K 
de i (- 5 tte,o + (2 — 26) Uy + 0 (4), -4 + 4-4, -1) — = tho, 3) 


= (L[u])o,9 + remainder term of the 3rd order. 


The corresponding finite equation reads 
0),0 = $[(2 — 20) Up, or o(U,, arte UL, =) =4 Up, =o oh ry 9] 


and for 0So<1 has the index jJ =. Putting o=1 we obtain the 
formula 
Uso =43([2 U,, pat 2 Uy, Si Up, = 2h? ry 9] , 


which is stable in the sense of § 3.4. As with the ordinary finite-dif- 
ference formula (1.13), this formula can be used over a sub-set of the 
whole set of mesh points, but here each row computed takes the solution 
twice as far as would a row calculated by (1.13). 


3. Third-order formulae. We can equate coefficients of all terms 
of up to the third order inclusive by using the constants a, 8, c, e, f. 
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The solution of the pertinent set of equations yields 


K 41 
@ — +{- 6 “0,0 + 3 Uy ~1 = 3 0,-2 + Mo, -s+ 
+20 & ZU, 1+ My -2 + (4-1 ae, 1) - (4-2 + 4_y -.)|} 


pz Ou OF : 
aor K Oy + cee -+ remainder term of the 4th order. 


The corresponding finite equation has the index J = #8 for O<a< 3; 
this is greater than that for either of the lower order equations and even 
the inclusion of the values u, _, and u_, _, does not improve it. [An 
expression with a smaller index is given in Z. Angew. Math. Mech. 
Bd. 16 (1936) p. 245]. A smaller index can be obtained with the 
Hermitian-type formulae of § 2.3. 


2.3. The ‘‘Hermitian’’ methods 


The idea of Hermitian-type formulae, which was introduced in 
Ch. III, § 2.4, for ordinary differential equations, can be readily extended 
to linear partial differential equations. Consider once more the dif- 
ferential equation (2.1). Instead of deriving a finite equation from the 
sum in (2.3), we use an expression of the form 


(L(g (2.11) 


where the C, , and D, , are constants to be determined; (L[«]), ,, denotes 
the value taken by the differential expression L{u] at the mesh point 
(c, x) and the summations are extended over a number of suitably chosen 
mesh points in the neighbourhood of a specified point (9, %)) with which 
the equation is associated. As in § 2.1, the mesh points occurring in 
(2.44) will normally be chosen so that C;,,,+ 0 and C, ,,,=0 for o=7; 
then with (L[w]),,—7,,, from (2.1) we use the finite equation 


C40 Dial a= 0 (2.42) 


to calculate the approximation U, ,,, from the U,, with x<. In order 
that the approximations obtained by using (2.12) shall be as good as 
possible, the coefficients C,,, D,,, are determined so that the Taylor 
expansion of the expression (2.11) in terms of u and its partial derivatives 
at the point (ty, %») is zero to as high an order as possible. 

Again we use the example of the inhomogeneous heat equation (2.6) 
to illustrate the derivation. With the same mesh points and the same 
notation a, b,c,... for the C,, as in § 2.2 and Fig. 1V/13, and with the 

19” 
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corresponding capitals A, B,C,... for the D,,, we write 


D = Atty 9+ buy 4+ 6 (ty 1+ Uy, -1) + €Mq, -2 + 
+ f (ty, -2 + 41, -2) +A(L["])o,9 + B(L[t])o 1 + (2.13) 
+ C {(L[#])s, -1 + (L[#]) 1, -1}- 


Taylor expansion in terms of u and its derivatives at the point (0, 0) 
yields 


®=ula+b+2c+e4+2f] + 
lit =e S26 awe 26) 2 
+ uz_| (20+ 2/) +4 +B+2C| +4 
+ ty,|= (0 + 20 + 4e-+ 8f) + KU(B + 20)] + (2.14) 
+ they (— 2¢ — 4f) —1(B +20) — CK] ee 
+ typ |= (— b—2¢—8e—16/)— 2" (B+ 20)| a 
+ terms of the 4th order. 


If each factor in square brackets is put equal to zero, we have six 
homogeneous equations for eight unknowns; we therefore express six 
of the unknowns in terms of the remaining two, say 4 and /: 


——— Sao — 1y44 +27, c=-—3oe - 7, 
2a 1 1 
1 KA KB KA MiG AKA 
Se oy eee ps oe ee ? aa — 
oo 2f, I 2(1 —9) i + 2f, l 9 / 
i : aeeit 
(with the usual notation o = elt 


/ 


: I 
Thus with «= re } we have 


; Uy o + 2004-28) Uy -1— (30+ €) (%4 4+ 4_y, 1) —- 
= (S Ai 26) My 2 te (uy, ae Moye) - {(L[#])o.0 ote 


+ 2(4 —o+ «) (L[™])o 4 +(o—e) ((L[«}),, -1 + (L[]) 1, -1)} - 
-+ terms of the 4th order = 0. 


(2.45) 


It is advisable to check the results of such a Taylor expansion, say 
by putting «= x*,y") 4", efe. 
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If the right-hand side of the differential equation (2.6) is a constant, 
say 7, then we obtain a very simple formula by putting e=0 ando =: 
— 2 (my, 1 + 4-1,-1) + Mo, - 6 | 


(2.16) 


++ remainder term of the 4th order. 


On account of the larger value of a, the calculation proceeds “forwards” 
more rapidly with the formula 


— 2AM =i F 41, -1) + 1-2 — Mo, 2 + H1,-2 61 

uu. — , 2 2 2 2? Samad. 

0,0 5 Pras oo (2.17) 
-++ remainder term of the 4th order, 


which is obtained by putting o=3, e=—+4. However, (2.16) has the 
index J =1 while for (2.17) J =1-4, and hence the convergence of the 
approximate solution to the solution of the initial-value problem is 
assured by § 3.3 for (2.16) but not for (2.17)}. 


2.4. An example 
Let us apply the Hermitian formula (2.16) to the problem 


Cu 
Ox? 


se +B =0 for \igle=4, V0; (2.18) 


u(x, 0) =u(— 1, y) =u(1, y) =i\9)5 (2.19) 


uw can be interpreted physically as the temperature at time y of an 
element of a thin homogeneous rod at a distance x from the centre 
when heat is generated internally at a constant rate and is conducted 
away at the ends so as to keep the temperatures there constant at the 
initial uniform temperature 0 of the whole rod. 

To start a calculation based on (2.16) we have to calculate the values 
U, , on the first row by some other means. We observe that u,,=0 
for the initial temperature distribution u(x, 0); hence, from the dif- 


2 
ferential equation, u, = 4 on y =O, and therefore 4,,,= a (<.) = 0 
on y=0. Since the differential equation ig that u, i 
follows that u,,=0 on y=0. This means that U,,+ U,,. ee, 


or, since U0) simply that U; _,.»=—U), - sone formula (2s ag) 
OU, n41 = 5 (2G 414+ 2G 1, boa) (2.20) 

where « = & He becomes 
U,1=4(U410+ G_1,0) +e% (2.21) 


1 Further formulae can be found in J. ALBRECHT: Zum Differenzenverfahren bei 
parabolischen Differentialgleichungen. Z. Angew. Math. Mech. 37, 202—212 


(1957). 
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when k=0. This formula gives the required starting values and the 
calculation can then be continued with (2.20). 


The results obtained with a mesh width h =} ( is then determined 
L 


=5 are shown in Table IV/13, which gives the values 


Table IV/13. Solution of the inhomogeneous heat equation by a Hermitian method 


1 0:83333 0-833 33 3-33333 | 1-66667 
2 1-666 67 1:66667 | 5 | 
a 1°833 33 2°5 8-66667 | 3°66667 
4 3:06667 sPisisiey sis) 9°46667 | 
5 2:593 33 4:06 13°30667 | 5:18667 
6 4:27467 491467 | 13-46404 | 
7 3°228 53 5°487 74 17°43254 | 645706 
8 0 534144 6°37313 | 17-05601 | 
9 3°78228 6°783 38 21-13132 | 7-56456 
40 629455 7:70133 | 20°:29043 
Steady temperature distribution: 
rn) 15 20 
8-75 | 18:75 
0 15 20 


of U; , (apart from a factor «) for x <0, the other half being symmetrical. 
The quantities formed in the row-sum check are 

S, =sum of all U; , in the »-th row, 

T, = sum of the two outermost U values in the »-th row; 
here the »-th row means the whole v-th row and not just the half row 
(x0) reproduced in Table IV/13. Then we should have 


- (4S, at S34~1) +ma, 


Sorta =- 


ur 


1 
5 


OAR ocx m = — (here m = 4). 


San =~ (4Se4-1 + Sopa — 2Tag_1) +(m— 1) @, 


The steady temperature distribution (the limit as v— ce) is given 
at the bottom of the table; it can be readily determined from the 
condition U; ,,. =U, ,. Since the exact steady temperature distribution is 
parabolic, the values obtained by the approximate method are exact. 
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§3. Some theoretical aspects of the finite-difference methods 
3.1. Choice of mesh widths 


The different mesh relations (1.12) and (1.33) for the parabolic and 
hyperbolic differential equations, respectively, are intimately connected 
with the different ‘‘domains of dependence” for these equations}. 
Consider, for example, the wave y 
equation se 

Oru 1 Gu 
O22 w? dy? G-1) 


a d & 


with given initial values of « and Wig 1V/14o Detconinete reaion 


du/dy on the x axis. Then the value 

u(x, y) at a point P (Fig. I1V/14) depends only on the initial data on 
that part of the x axis, a<x<b, which is cut off by the two ‘‘charac- 
teristics’ through P; this is called the ‘domain of dependence”’ of the 
point P. Reciprocally, the segment a<x<b of the x axis and the 
characteristics emanating from its endpoints define a region (shaded in 
the figures) in which wu is determined completely by the initial values 
of wu and du/dy on the segment; 
this may be called the “‘determinate 
region” of the initial segment. 

If we apply the finite-difference 
method on a mesh with A =» and rt 
with the points (a, 0), (6, 0) among 
its mesh points, we find that the 
initial values in aX x<b determine \ a Y y | i 
the U, , at the mesh points in the Ny Wy 
triangle formed by the x axis and Ml, W, = 
the straight lines x—Evy = constant Fig. 1V/15. The finite-difference determinate region 
which pass through the points 
(a, 0) and (6, 0), respectively (these mesh points are circled in Fig. IV/15). 
Now if the number 1/y is chosen too large, greater than 1/m in fact, 
then this finite-difference ‘(determinate region’? extends beyond the 
actual determinate region of the initial segment a<x<b. This means 
that from initial values ina< x <6 the finite-difference method produces 
values for u at points where w is influenced by initial values outside 
of axx<b. In this case, therefore, we cannot expect the finite-difference 
approximations to converge to the exact solution of the differential 
equation as the mesh is refined. However, convergence can be proved 
for y =m and also an error estimate can be obtained (see § 3.2). 


1 See R. Courant and D. HitBert: Methoden der mathematischen Physik, 
Vol. II, p. 307. Berlin 1937, or R. Courant and K. O. FRIEDRICHS: Supersonic 
flow and shock waves, p. 51. New York: Interscience Publishers Inc. 1948. 
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Similarly, convergence to the correct solution cannot be expected when the 
finite-difference method is applied to the heat equation @?u/d%#*= du/dy with a 
constant mesh ratio h/!=v. This can be seen by considering the exact solution 

— x? 


or a (3.2) 


which is always positive for y>0 and vanishes on the ¥ axis except at +=0. 
Now if 0<a<b, the finite-difference method would always give zero values in 
the large triangle of Fig. 1V/15; for constant » this is a fixed triangle and con- 
sequently the results would necessarily converge to the wrong solution. 


3.2. An error estimate for the inhomogeneous wave equation 


We choose here an example admitting of an explicit error estimate 
from which the convergence? of the solution of the finite-difference equa- 
tions to the solution of the differential equation can be inferred directly. 

Consider the initial-value problem for the inhomogeneous wave 
equation 


2 2 
Lu] = 24 —~ 4 £* —4(x,y) (3.3) 
in which the values 


u(x,0) =G(x) and one) = Hie) (3.4) 


are given on the initial line y=0. The treatment which we shall give 
here can still be applied when the boundary conditions are more general 
than this. 

First we write down the finite-difference equation corresponding to 
(3.3) for the mesh (1.1) (with x) =%)=0): 


EO eS ee eee) 

1 The proof of convergence may be carried over to more general problems; 
see R. Courant, K. Friepricus and H. Lewy: Uber die partiellen Differenzen- 
gleichungen der mathematischen Physik. Math. Ann. 100, 32—74 (1928). — 
Friepricus, K., and H. Lewy: Das Anfangswertproblem einer beliebigen nicht- 
linearen hyperbolischen Differentialgleichung beliebiger Ordnung in 2 unab- 
hangigen Variablen; Existenz, Eindeutigkeit und Abhangigkeitsbereich der Lésung. 
Math. Ann. 99, 200—221 (1928). — Courant, R., and P. Lax: On nonlinear 
partial differential equations with two independent variables. Comm. Pure Appl. 
Math. 2, 255—273 (1949). — Courant, R., E. Isaacson and Mina REEs: On the 
solution of non-linear hyperbolic differential equations by finite differences. Comm. 
Pure Appl. Math. 5, 243—255 (1952), in which the system 


2 («1,2 + bj Fat) = 6; (f=) 1), ,..<988) 


is considered, where a;;, bs, cj are functions of 4, y, 4, ..., Uy. 
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With 4 =o this simplifies to 
— WAL, LU] = 41 — Osan) — (Caan — Una) =— 4. (3.6) 
On the initial line y =0 we have 

U9 = t,o = 4(ch, 0) =G(ch). (3.7) 
The values of U on the line y =A are determined by the other initial 
condition 

Ua _ Ou(th,0) , 

se (3.8) 


U, _, can be eliminated between this equation and (3.6) with x =O, i.e. 


U, To CE Cee Dies Seas Ht, 9, 


4, 


to obtain 


Uy = Scns tne +h H(eh) — “4. (3.9) 
The solution U,, calculated from these starting values by repeated 
application of (3.6) can be given explicitly. From (3.6) we have 


= 2 —_ 
Oe, —_ U.43,x-1 aa Cee — U, 2 —h eee ame 
x—2 
ae 2 
a Ura a U_4+2,0 Sp Ps ere 


v= 


and similarly 
x—3 
Ce el aa Uees = U_ x43, ) eas Orta 0 ae > Li ytalatee 8 
v=0 
Ol ae 2 Oa, 1 “4+%-3,1 “t+x—2,0 h bet e—2,1° 
Addition of these equations then yields 
* x—1 “x—l xw—p 
2 
Uy = > Or eray= aa > U 23450 ma) 2 a fg ails (3.10) 
= v=1 p=l s=1 
sum (i) sum (ii) sum (iii) 


The summations (i) and (ii) extend over the U values at the points 
circled in Fig. IV/16 and the summation (iii) extends over the values 
of ¢ at the points marked with crosses. 

We now derive an upper bound of the form constant xh? for the 
absolute value of the error in the approximation U at an arbitrary but 
fixed point in the determinate region for the difference equations; this 
implies the convergence of the solution U, ,, of the finite-difference equa- 
tions to the solution (assumed to be differentiable sufficiently often) of 
the differential equation. 
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If M, is the maximum value of | @’u/0x’| and | @u/@y"| (for »y=3, 4). 
in a convex region of the (x, y) plane which includes all mesh points 
involved in the calculation, then it foilows from (3.5) (for remainder 
term see Table III of the appendix) that 

2 2 
Bag ce ee a ae ce 8, ,M, =, a Oe 


Ox? w? dy? 
where |#,,,|1; hence the error e=U—u satisfies the difference 
equation 
2 
Ll] =—+0,,M, with [0,,|S1. (3.44) 


Fig. IV/16. Construction of the closed solution of the difference equations 


Since on the ‘‘starting line’ y —h we have 
U1— U1 _ Ou(th,0) 3 . 
61 bl a ae 0. Ms with |#| <1, 
it follows from (3.8) that 
Gt Waa ee RB 
2h AG us, 
and since €, »=0, from (3.14) with x =0 we also have 


ha 
&y1 a €,-1 Sa (A 8,0 Mi; 


we can therefore specify an upper bound for the errors on the starting 
line y=h: 


lealSSlea— A ee aes Lon a ‘ 


~ Wheeee  M,. (3.42) 
We now use formula (3.10) to solve ae : 


aN mae 7 2 | x « 
Ene — Lo &4-2941,1 Ds f420+2,0 — My » > Pane 


(i) (ii) “tity 
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The terms in sum (ii) are all zero, the terms of sum (i), x in number, are 
each bounded as in (3.12) and the 4 (x—1) terms of sum (iii) are each 
of absolute value 1 or less; therefore 


nA 
12 


3 4 
JU tal =| unl SH (G5 M+ My) +E Myint — x). 


Substituting for « = y/h we have 
he 
|U,«— «| S5 (2y M+); (3.13) 


thus the error at a fixed point (x, y) tends to zero quadratically with h 
as the mesh is refined. 


3.3. The principle of the error estimate for more general problems 
with linear differential equations 


Let the Taylor expansion of the expression (2.3) coincide with the 
given differential expression in (2.1) up to the terms of the 7-th order 
(y=m) inclusive. Under the assumption that in the region considered 
all the partial derivatives of u of the (y-+1)-th order exist and are 
bounded, say by M_,, in absolute value, the remaining terms in the Tay- 
lor expansion can be collected together into the single remainder term 
oDI'~-™**M,,,, where |#|<1 and D depends on the mesh and the 
differential equation but not on the function 4; in fact D is a polynomial 
in / of at most the m-th degree. The estimation of the quantity M,, 
often causes difficulty in practical applications; to get an idea of its 
order of magnitude one can sometimes calculate approximate values for 
the partial derivatives from the differences of the numerical solution. 


Using this remainder term we can write 


> Co. U, x — L[ 1, x9] ote 0 1S aslo) lar (3.14) 
The error ¢,,, =U, ,, —%,,, therefore satisfies 
DNC... 8.4 = — ODI Ms. (3-15) 


If we know limits for the errors in the first k rows, this formula 
enables us to estimate the errors in the (k | 1)-th row; in principle, 
therefore, a recursive error estimate is possible. To apply it, we need 
limits for the errors in the ‘‘starting’’ rows, i.e. the rows with x =O, 
1,...,8 if the values of x occurring in the finite equation (2.2) differ at 
most by s. If # is determined uniquely by prescribed initial data on 
the x axis, so that theoretically we can calculate the value of any partial 
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derivative of # at y=, then the values of U, ,, in the starting rows could 
be calculated from the Taylor series 


Ue M,o+ YP Foye (% =0,1,2,...,8 —1) 


(some other special starting procedure may be possible, of course); we 
could then use 


r+1ir7+1 
lee) SS Ma (6 O71, 2,-2.5 — 4) (3.16) 


as the required limits for the starting errors. 


I} the index J introduced in (2.5) is not greater than one, then in cases 
with r>m an independent, as opposed to a recursive, error estimate can 
be given which implies the convergence of the finite-difference approximation 
to the solution of the initial-value problem. We imagine the differential 
equation (2.1) to have been multiplied through by such a factor that 
the coefficient C; ,,, in the finite equation (2.2) is unity; then the finite 
equation (2.4) reads 


Un py =— 26,60 etm (3.47) 


“sk 


Under the assumption J <1, the corresponding equation for the error 
age — by) Chi — OD oe ii, 
yields the estimate a 
| Sena SS mex (|e; (lees l..2-| Ex—sail) +M, (3.48) 
where | ¢, | = max |e, ,,| and 
Mies Rie Ey 


If boundary conditions are imposed which prescribe the values of 
on, say, two straight lines which are used as mesh lines, then ¢=0 
there. With C denoting the largest of all the limits in (3.16), it follows 
from (3.18) that for x=s—1 


le..IS¥,=C+(%e—s4+1)M 


—4)nrtt ae 
= free + ( a) a6 1) Dinas l” | M, 41. 


| 6.9 


If r>m, these error limits tend to zero with / at a fixed point (x, v) 
with y=x/; this is still true when y =m provided that the polynomial 
D has the mesh width / as a factor [this is always the case, for example, 
when the given differential equation (2.1) has no undifferentiated term 
in #, i.e. Ap 9=0). 
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The condition J <1 and this last condition are satisfied, for example, 
by formula (2.10) for the inhomogeneous heat equation provided that o 
is chosen in the range 0<o<4; thus we have shown, in particular, 
that the finite-difference formula (1.13) yields convergent approxima- 
tions! and that an error estimate can be given for them. 


3.4. A more general investigation of error propagation and “stability” 


Various courses have been pursued in the quest for systematic means 
of determining the ‘‘stability”’ characteristics of finite-difference equa- 
tions, i.e. for criteria which will indicate whether or not the calculation 
can be rendered useless by unfavourable error propagation. Here we 
describe first a very simple method? by applying it to the initial-/ 
boundary-value problem for the heat equation u,,— Ku, with prescribed 
values of u(x, 0), «(0,¢) and u(a, Z). 

Let the mesh widths h,/ be given by h=a/N, 1=Kah?, where N 
is an integer and o is arbitrary for the present. We assume that the 
values U; on the first row have certain errors ¢; and ask whether the 
solution of the difference equations 


sees SEE eas an K = Uk =0Q 


remains bounded or not as k—> co. 
Provided that « and f are related by 


2(cos Bh — 1) _kK es = 


h2 


ce 
e~! —4 — 4osin? ds , 


u =e*'sin Bx is a solution of the difference equations. 


1 Convergence for the case with ~ prescribed on the whole ¥ axis and with 
o = 7% is proved in the paper by R. Courant, K. Frrepricus and H. Lewy already 
referred to: Math. Ann, 100, 32—74 (1928); for the region defined by the strip 
O<*Sa, y=0O and under certain restrictions on the prescribed boundary values 
convergence is proved for 0 <o<} by W. Leutert: J. Math. Phys. 30, 245-251 
(1952), and for 0<o<# by F. B. HILDEBRAND: On the convergence of numerical 
solutions of the heat-flow equation. J. Math. Phys. 31, 35—41 (1952). 

2 Brien, G. O., M. Hyman and S. Kapran: A study of the numerical solutions 
of partial differential equations. J. Math. Phys. 29, 223—251 (1951). — Hyman, 
M. A.: On the numerical solution of partial differential equations. Vroefschrift 
Techn. Hogeschool, 106 pp. Delft 1953. Cf. also J. Topp: A direct approach to 
the problem of stability in the numerical solution of partial differential equations. 
Nat. Bur. Stand. Rep. No. 4260, 1955, 27 pp. 
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Now if we imagine the initial errors e, to be expressed as a finite 
trigonometrical series of the form 


oe EL 
U,9=e& = = sin —; 
and replace «, 8 by «,, 8, with 8, = ——, then the required solution of 


the difference equations is 


N-1 e 
U => Ari ne 
v=] 
We see that the U; ,, will remain bounded for an arbitrary initial perturba- 
tion, i.e. for ec A,, if and only if |e*'| <1 forx=1,2)... a—ae 
this is equivalent to the condition 


4o Se, 


and since sin?i8,.4<1, we obtain as the condition for stability 
2Py y 


Le 


ca i.e. ls >. (3.20) 


AD 
Equation (1.12) actually specifies the greatest possible value permitted 
by this condition, namely /=4Kh?; this value is also recommended in 
§ 2.2 (1st-order formulae). 

To avoid any possible misunderstanding, we once more state explicitly 
that we are concerned here only with the stability behaviour of the solu- 
tion of the finite-difference equations and do not say anything about 
the deviation from the solution of the corresponding initial- or initial-/ 
boundary-value problem. 

Similar procedures can be carried out in several other cases. The 
technique required for dealing with the effects of an isolated disturbance 
at one mesh point is considerably more complicated than for a dis- 
turbance of the form sin 8x; nevertheless, such isolated disturbances 
have been investigated for fairly general differential equations! 

However, for cases in which J<1, J being the index defined in (235), 
at can be seen immediately that the influence of an isolated disturbance 


1 This theory goes back to JoHN v. NEUMANN: it has been discussed by 
R.P. Eppy: Stability in the numerical solution of initial value problems in 
partial differential equations. Naval Ordnance Labor. Memorandum 10, 262 
(1949). — Numerous other papers have been written on the question of stability; 
suffice it to mention just a few: Topp, J.: A direct Approach to the Problem of 
Stability in the Numerical Solution of Partial Differential Equations. Comm. 


Pure Appl. Math. 9, 597—612 (1956). — Lax, P.D., and R. D. RicntMyeEr: 
Survey of the Stability of Linear Finite iii Equations. Comm. Pure Appl. 
Math. 9, 267—293 (1956). — MLaK, W.: Remarks on the stability problem for 


parabolic equations. Ann. Polonici Math. 3, 343—348 (1957). 
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remains bounded; thus the finite-difference method is always stable when 
the formula used has J <1. On account of the linearity of the differential 
equation a disturbance ¢;, superimposed on the solution of the dif- 
ferential equation is propagated according to the homogeneous equation 
corresponding to (2.4), i.e. 

E,kti=— FG : DEC. Eva (3.21) 


i,k+1 eas 


As in § 2.1, the sum extends over all ¢, for which C, ,+:0 except 
*—=k-+1. From the definition of J (2.5) and the fact that it does not 
exceed 1 we see that 

| ¢;,e+1| Smax|e,,,|. 


Therefore, if we introduce an isolated disturbance Ej,,k, = 1, So that 
€,,=0 for x<f, and also for x =f» except when «=1%), we must have 
| €; g41|21 for all REy. 

The assumption /<1 is satisfied, for example, by equation (2.10) 
for the heat equation provided that o is chosen in the range OSo0S3; 
this is the same condition as (3.20). 


3.5. An example: The equation for the vibrations of a beam 


For illustration we select an example from the theory of the flexural 
vibrations of thin beams which neglects such subsidiary effects as those 
due to the changing inclinations of the elements of the beam. In this 
theory the displacement of the beam satisfies the differential equation 

Au au 

ne as 8 (3.22) 
Some typical initial and boundary conditions which arise are: 
initial conditions (given initial displacement and velocity distributions) : 


u(x,0)=A(2), SBI = f(x) for oSxSa; 


boundary conditions (smoothly pinned ends) : 


_ dul(o,y) _ , — u(a,y) _ oe 
u(0, y) = ae u(a, ¥) a for VamO. (3.25) 
For a rectangular mesh (1.1) with mesh widths h =a/N and / (where 
N is integral and greater than unity) the ordinary finite-difference 
method replaces the differential equation (3.22) by the difference 
equation 
Ui4a,e—4Uitae+ OU, 2— 44 —1,0+ Gok 4 


h* (3 24) 
fee kia ee Uir-1 K — 0. 
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As we did for the heat equation in (1.12), let us choose a convenient 
mesh relation; with 
Nhtjes! 


the difference equation simplifies to 
Upuge — Upp g » Aa, 4 Upper 8U, 1 em Cae — Cle. 128) 


Once we have found values on two consecutive rows, this formula 
will give the values on the next row, and it would appear that we could 
therefore continue the solution as far as required; however, a glance 
at the propagation table of formula (3.25) shows immediately that it is 
quite unsuitable for repeated application — just the few rows given in 
Table IV/14 proclaim its severe instability. 


Table IV/14. The propagation table of formula (3.25) 


4€ | —4e 46 —eé | 0 
—40e | 49e —406 246 | —8e 
496¢ | —560e | 4966 —337e | 172 

—6200e | 6833€ | —6200e | 


Our choice of mesh relation implies too large a value for the mesh 
width / for given h. To investigate a better choice of mesh relation, 
let us introduce the parameter! 


z:=—. (3.26) 


The formula (3.25) just considered arises as the special case 2 = 


Suppose that at some stage of the calculation the U,, values on the 
last two rows, say k=p and k=f-+1, have deviated from their true 
values by errors ¢; , and €; 44,, respectively. Then we ask again whether 
the errors ¢,, produced in subsequent rows by using (3.24) remain 
bounded or not as kR> ox, 

It can easily be shown that equation (3.24) possesses the particular 
solution 

U,, =et-* "sing, 
if £ and 7 are related by 


2z(cos € — 1)" = 4 — coshn; (3.27) 
therefore with & = f= = (1=1,..., M— 1) and corresponding values 


n=+7, from (3.27) 
eel r 
v= > sin i (A, e@—?)m 4B e—(h—P) mm) 


1 CoLiatz, L.: Z. Angew. Math. Mech. 31, 392—393 (1951). 
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is also a solution of (3.24). Moreover, it satisfies the finite-difference 
boundary conditions corresponding to (3.23) and by a suitable choice of 
A, and &, can be made to assume the values ¢, , and E; p41 for k=p 
and k=p +1, respectively: if we obtain quantities ,, 8, from 
N-1 . N-1 . 
_ - JV EG 
ep = Lim _ nee = 2B in 


by the formulae of harmonic analysis, then, since n, +0 (cos +1 and 
z= 0 imply that cosh 7 +1), the A, and A, are uniquely determined by 
the equations A,+ B,=a,, A,e”+ B,e~v=8.. 

With these values of A, and B, we have v;,—¢,,, and we see that 
the ¢;, will remain bounded for an arbitrary error distribution on rows 
p and +4, ie. for arbitrary A,, B,, if and only if 


|e*|=1 for v=1,...,N—1. (3.28) 


Now let s ~=1—cosh y and |im7|a. When s is real and positive [as 
it is here by virtue of (3.27) with €=va/N|, the corresponding values 
of 7 lie on the imaginary axis for 0<(s=2 and on the lines imy=+27 
for 62; hence |e"| =1 for 0~sS2 and |e”| >1 for s>2. From (3.27), 
(3.28) our stability condition therefore reads 


2z(cos§ —1)?S2 or zS : 


This upper bound for z depends on N, though not strongly; a simple 
sufficient condition for stability which is valid for all N can be obtained 
by taking the limit as Nw, i.e. by replacing the cosine in the de- 
nominator by —1: 


2S 


lm 


With z=1 (3.24) becomes 
Oyu hig 1 FU a yy F 


} 1,48 i 


id if 
& 20, ft 4 Cg f 2, x) 


(3.29) 
The index of this formula is / =4 while that of (3.25) is 15. 


§4. Partial differential equations of the first order 
in one dependent variable 


A complete theory for the integration of partial differential equations 
of the first order in one dependent variable u(x,, %2,...,%,) and n 
independent variables x,, x2, ..., X, has existed for many years. In this 
theory the integration of the partial differential equation is reduced to 
the integration of a system of ordinary differential equations, and hence 


Collatz, Numerical treatment, 3rd edit., 2nd print. 20 
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a numerical treatment can be based on the methods described in 
Chapter II. Our presentation of the theory! here will be confined to 
a summary (in § 4.1) of the results needed for a numerical calculation. 

In spite of the completeness of the theory, the numerical integration 
of the systems of ordinary differential equations which arise is very 
laborious and there is a need for other approximate methods which will 
give a quantitative idea of the solution with a moderate amount of 
computation. We therefore go into other possible methods of treatment, 
albeit briefly, in §§ 4.3 to 4.5. 

Unless otherwise stated, all functions and derivatives which occur 
are assumed to be continuous. 


4.1, Results of the theory in the general case 
Consider the first-order partial differential equation 


F(t, %1, X%qs +00) Xp» Pr» Pgs>>+> Pn) =O (4.1) 


for the function 4(%,, x2,...,x,) of the independent variables x,, %5,..., x 
The ; denote? the partial derivatives of 


n? 


2;=5- (7 = 1,2, ...,%), (4.2) 


and F is a given function which will be assumed continuous in the 
arguments specified. 


This differential equation is called linear (see Ch. I, § 1.3) when F 
is linear in # and the #,, i.e. when it has the form 


j= 


ne 


where A, B and the A, are given functions of x1, %2,..., % 


It is called quasi-linear (Ch. I, § 1.3) when F is linear only in the #,, 
i.e. when it has the form 


SA, = B, (4.4) 


where now the A, and B are given functions of x,,..., x, and w. 


1 Presentations of the theory can be found, for example, in R. Courant and 
D. Hirsert: Methoden der mathematischen Physik, Vol. II, in particular, pp. 51 
to 122. Berlin 1937. — Kamke, E.: Differentialgleichungen reeller Funktionen, 
4. Abschnitt, 2nd ed. Leipzig 1944. — Saver, R.: Anfangswertprobleme bei par- 
tiellen Differentialgleichungen, Ch.2. Berlin-Gottingen-Heidelberg 1952. — 
Durr, G.: Partial differential equations, Ch.s II, III. Toronto 1956. 

*In Ch. I, § 1.3 the partial derivatives were denoted by u, instead of p;; by 
using the letter p here we conform to the notation customary in the literature. 
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Let initial values be prescribed for the unique determination of the 
function 4; in fact let an (m —1)-dimensional manifold be defined by 
prescribing « and the x, as functions of parameters 4,,..., t,_4: 


ON sta GA, --sotthy = t0lby, «yer 


1 1 
This manifold may be extended to a “strip manifold” C by including 


m functions 9; (t,,...,4,-1) which satisfy the following conditions: 
the strip conditions (n —1 in number) 


a eG Sit =the) (4.5) 
and the oe condition 
MMEHRG «0s, Xp sp Piss, Py) =O. (4.6) 


To solve the initial-value problem a function u(x,,..., x,) must be 
determined which satisfies the differential equation (4.1) and defines a 
surface containing the manifold C. 

An expression which is critical for the solubility of this initial-value 
problem is the determinant 


Fs, i, F,, 
a 
A 1ec4 ot, oh |. (4.7) 
O*, Ox, OX, 
Ci Cl Oty-4 


We shall assume that this determinant A 1s non-zero at all points of the 
initial manifold C ; then the existence and uniqueness of the solution u 1s 
assured (always assuming the continuity of all functions which appear). 

The solution « can be built up from the “characteristic strips’. 
These are one-dimensional strip manifolds defined by (2 +1) functions 


u(s), x;(s), ,(s), (4.8) 


of a parameter s which satisfy the system of “characteristic equations” 


du “1, OF dx; OF 

i oS Pr ’ l=, ml (4.9) 

ds 2 Op, ds 0p; C4, Same 

a el 4.10 

a Ox ; cu ( ) 
To each set of values ¢,, ..., ¢, 1, 1-e. to each point of the initial manifold 


C, there corresponds one such characteristic strip. The system of (2” + 1) 

ordinary differential equations (4.9), (4.10) for the (2% + 1) functions #, 

x;,p;, together with, say, the initial conditions that for s=0 the 4, 
20% 
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x;, p; take the values corresponding to a point of the initial manifold C, 
determine the functions (4.8) and can be integrated numerically by the 
methods of Chapter IT. 

Quasi-linearity of the differential equation (and hence linearity in 
particular) introduces a considerable simplification: with the equation 
in the form (4.4) the first (x +1) equations of the characteristic system 
(4.9), (4.10) become 

sd O34 = A, 


ds , ds 
in which the #; no longer appear; thus we need no longer concern our- 
selves with the #; and can ignore the equations (4.5), (4.6) and (4.10). 
Instead of the characteristic strips we have ‘‘characteristic curves’’ u(s), 
x;(s), which are solutions of (4.11) and are ordinary space curves in the 
(x + 1)-dimensional (#, x;) space. The determinant (4.7) becomes 


G= 4p 2 (4.41) 


A, = Ag 
Ox, 0%, 
A=| %  % (4.12) 
ig Bed. 
Othe, Oty, 
and provided that it does not vanish, the solution #(1,,..., x,) consists 


simply of the totality of characteristic curves which pass through the 
points of the initial manifold. 


4.2, An example from the theory of glacier motion 
A non-linear differential equation in two independent variables which possesses 
the simplifying property of quasi-linearity occurs in the theory of glacier motion}?. 
It furnishes a mathematical description of the conditions in a glacier, particularly 


u in the glacier tongue, or ablator, and appears in 
the form 
Ou ou 
[(m + 1) 24" — a] —- + - =— a, (4.13) 


Ox 86 at 
It pertains to a central longitudinal section of 
a glacier moving down a slightly inclined, 

straight bed. 
The variables « and x refer to oblique axes 
alt _ © in the plane of the section: « (+, t) is the vertical 
rey) uf ieee bextion depth of the ice at time ¢ at a distance x along 
the bed (Fig. IV/17). The velocity distribution 
is assumed to be of the form v =x", where x depends on the slope of the bed 
and the exponent n is a constant lying between } and }. The remaining symbol a 


1 See S. FINSTERWALDER: Die Theorie der Gletscherschwankungen. Z. Glet- 
scherk. 2, 81—103 (1907). This gives a detailed treatment of various cases of 
stationary glaciers, propagation of ridges, glacier shrinkage, the relative slipping 
of complete ice-blocks, etc. 
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is an ablation constant; it represents the annual melting on horizontal surfaces. 


The particular example which we consider here concerns a receding glacier on a 
very flat bed. 


Let the shape of the longitudinal section of the glacier at time t=0 
be given? in dimensionless variables by 


=o 0S * 54 (4.14) 


—— Exact solution 
(lines t=const.) 
---— Characteristics 
(projections) 
x x Points calculated by the 
cruder of the ordinary 
nw Minite— difference methods 


0 7 2 3 ‘ 4¥ 


Fig. 1V/18. Profile of a glacier at various times as an example of the integration of a first-order partial 
differential equation 


and for numerical values of the parameters take n = 4, x =0-075,a=34 
Then (4.13) becomes 
8 ou a 
aye 05. (4.15) 


The characteristic equations (4.11) for equation (4.13) read 
dt 


dx _ an at 
: =(n +1) xu" —a, ea (4.16) 


Their general solution is a two-parameter family of curves in the (#, x, ¢) 
space; in this case the curves are plane and are given by 


ee atl — — (0-4 ‘s 
+E ; u +u=4u 45 5, 4.47) 
u+y=—at =—0-52, 


1 With a more sloping bed (greater x) and sufficiently large values of u the 
projections of the characteristics on the (%,/) plane slope away from the ¢ axis 
instead of towards it (dx/d!<v); then for the complete determination of u(x, 4) 
in the quadrant x>0, ¢>0, (0, ¢) must be prescribed in addition to u(%, 0). 
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where & and 7 are the parameters. From this two-parameter family we 
select the one-parameter family of curves which pass through the points 
of the initial curve (4.14); the surface formed by the totality of these 
curves constitutes the solution of the problem. We select a set of points 
on the initial curve and calculate the corresponding characteristic para- 
meters; for example, the point ‘=0, *=3, u=1 yields =— 2-45, 
”=1. Then the projections of these characteristics may be drawn in a 
(u, x) plane and graduated at (say equal) intervals in ¢; curves joining 
the points with the same values of ¢ give the shape of the longitudinal 
section at various values of ¢ (Fig. IV/18). 


4.3. Power series expansions 


If, as will always be assumed, the determinant (4.7) is non-zero over 
the given initial manifold, it is possible, in principle, to calculate the 
initial values of the higher partial derivatives of wu. The solution can 
therefore be approximated by a number of terms of its Taylor series 
and this will give some idea of its behaviour in a neighbourhood of the 
initial manifold. Naturally nothing can be asserted generally about the 
extent of the region of convergence. Such a series expansion should 
always be used circumspectly, for the series can converge in certain 
regions to a limit function which is not the solution of the initial-value 
problem; examples which demonstrate this can be constructed quite 
easily (the example in the introduction to this chapter demonstrates the 
same phenomenon for a second-order equation). 


The higher derivatives are calculated by repeated differentiation of 
the differential equation and of the initial conditions with respect to 
the x;. By differentiating the differential equation and initial conditions 
in the form (4.5), (4.6) with respect to x,, for instance, we obtain a 
system of linear equations for the quantities ,,, #),,-...,4,, (with 
the derivative notation of Ch. I, §1.3); now the determinant of the 
coefficients obtained is precisely the determinant (4.7), which is assumed 
to be non-zero, and we can therefore solve for the derivatives 1,,, 
Wer, ++» Uni 


As an illustration consider the example of the last section § 4.2. Let us write 
f=a—(n4+1)4u", u(x,0)=g(x), n(n+1)xg"1=@; (4.18) 
then the differential equation (4.13) reads 


Wp= —at fay 
and the initial condition is 
4—% 


“u(¥,0) = p(*%) =2 ae 
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Differentiation of the differential equation with respect to x and #¢ yields the 
two equations 


Upp = — Dut + furs, 
Uyp= — Du, uy + fuy, 
for the required values of the second derivatives on the initial manifold ¢= 0. 
Two differentiations of the initial condition yield 
, 2 4 


4,=GF=- e— ae" a oa dl ar 


Thus we have three linear equations for u,,, u,,, 4,,, which in this case can 
be solved directly by successive substitutions. For u,,, for example, we obtain 


u” 704 , 1 
Uy, = fry — 2/9 2+ addy = xs 


[SD + 4(5 — x) fP-+ (5 — x)? D]. (4.19) 


4.4. Application of the finite-difference method 


Of the possible ways of making a rapid quantitative survey of the 
solution without a laborious integration of the characteristic equations, 
the finite-difference approach is probably the most suitable. The mesh 
width in the progressive direction must not be taken too large, of course, 
for, as in § 3.1, if the method is to make sense, the finite-difference 
determinate region of any part of the initial manifold must be completely 
contained within the corresponding determinate region outlined by the 
characteristics. Consequently the finite-difference method should not 
be used without first examining the run of the characteristics at least 
roughly (cf. the example). 

There are usually several ways in which the differential equation can 
be replaced by a difference equation; we illustrate two ways — one 
more accurate than the other — by applying them to the example of 
glacier shrinking of § 4.2, i.e. the initial-value problem (4.15), (4.14). 
We employ the usual rectangular mesh 


x,=th, y,(here?,) =k, 


and in order to choose / suitably we first estimate the steepness of the 
characteristics. From (4.16) and using the fact that w20 (the depth 
of the glacier cannot be negative) and also that 0-5 — 0-4 Vu od, we have 


[(m + 1)%u* — a| lo-5 — 0-1 Vu | 0-5 


dt 
ax 


thus we can safely choose /<22h and for our example we take 1 A= 3. 

1. The cruder method. Here the derivative with respect to x is 
replaced by the central difference quotient (1.4) but the derivative with 
respect to ¢ is approximated crudely by the forward difference quotient 
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Now if we imagine the initial errors ¢; to be expressed as a finite 
trigonometrical series of the form 


eel fH 
U9 = 6; ‘as sin —y 
and replace «, B by «,, B, with £, =-——_, then the required solution of 


the difference equations is 
N-1 ; 
Up Agee cin es 
v=1 


We see that the U; , will remain bounded for an arbitrary initial perturba- 
tion, i.e. for ale ota A,, if and only if |¢*"| = (ieey — 1a ge 
this is equivalent to the condition 


Ao sin? a <2. 
and since sin? 38,4 <1, we obtain as the condition for stability 
oss, Le aie (3.20) 


Equation (1.12) actually specifies the greatest possible value permitted 
by this condition, namely /=4$Kh?; this value is also recommended in 
§ 2.2 (14st-order formulae). a 

To avoid any possible misunderstanding, we once more state explicitly 
that we are concerned here only with the stability behaviour of the solu- 
tion of the finite-difference equations and do not say anything about 
the deviation from the solution of the corresponding initial- or initial-/ 
boundary-value problem. 

Similar procedures can be carried out in several other cases. The 
technique required for dealing with the effects of an isolated disturbance 
at one mesh point is considerably more complicated than for a dis- 
turbance of the form sin 6x; nevertheless, such isolated disturbances 
have been investigated for fairly general differential equations}. 

However, for cases in which J <1, J being the index defined in (2.5), 
at can be seen immediately that the influence of an isolated disturbance 


1 This theory goes back to JoHN v. NEUMANN; it has been discussed by 
R. P. Eppy: Stability in the numerical solution of initial value problems in 
partial differential equations. Naval Ordnance Labor. Memorandum 10, 232 
(1949). — Numerous other papers have been written on the question of stability; 
suffice it to mention just a few: Topp, J.: A direct Approach to the Problem of 
Stability in the Numerical Solution of Partial Differential Equations. Comm. 
Pure Appl. Math. 9, 597—612 (1956). — Lax, P.D., and R. D. RicHTMyEr: 
Survey of the Stability of Linear Finite Difference Equations. Comm. Pure Appl. 
Math. 9, 267—293 (1956). — Max, W.: Remarks on the stability problem for 
parabolic equations. Ann, Polonici Math. 3, 343—348 (1957). 
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vemains bounded; thus the finite-difference method 1s always stable when 
the formula used has J <1. On account of the linearity of the differential 
equation a disturbance ¢;, superimposed on the solution of the dif- 
ferential equation is propagated according to the homogeneous equation 
corresponding to (2.4), i.e. 


1 
é; = — CME ve eh 
#, A+ 1 Gee aed Ed (3 ) 


As in § 2.4, the sum extends over all 1, for which C, ,=—0 except 
*%—=k-+41. From the definition of J (2.5) and the fact that it does not 
exceed 1 we see that 

[e241] mex | ex - 


Therefore, if we introduce an isolated disturbance ¢,,,=1, so that 
€,,=0 for x<h,y and also for x =k, except when t=), we must have 
lé; a41|1 for all REAy. 

The assumption J/<1 is satisfied, for example, by equation (2.10) 
for the heat equation provided that o is chosen in the range OSo0 S$; 
this is the same condition as (3.20). 


3.5. An example: The equation for the vibrations of a beam 


For illustration we select an example from the theory of the flexural 
vibrations of thin beams which neglects such subsidiary effects as those 
due to the changing inclinations of the elements of the beam. In this 
theory the displacement of the beam satisfies the differential equation 


iy eke (3.22) 


Some typical initial and boundary conditions which arise are: 
initial conditions (given initial displacement and velocity distributions) : 


u(x,0) =A,(%), one. 0) = fy(x) for O<*xSa; 


boundary conditions (smoothly pinned ends): 


u(0, y) = = Bas u(a, Y) = See) =0 for y2O. (3.23) 
For a rectangular mesh (1.1) with mesh widths =al/N and / (where 
N is integral and greater than unity) the ordinary finite-difference 
method replaces the differential equation (3.22) by the difference 
equation 
U;+a,k— 4 Uj+1,k ite 6U; p—- + U;-1,4+ U;_2,k = 
ha 


ae Uti — 2G, n+ Uir-1 K =; 


12 
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can be used at the boundary 7 =0 (there is a similar formula for the 
other boundary). This is permissible because in the region of interest 
(420) the characteristics have dx/dt<0 and the region therefore lies 
within the determinate region of the initial segment 0<x<4, t=O. 
Thus we may proceed until the U, , become negative. 


t 


2. The more accurate method. Here we replace the derivatives 
with respect to x and ¢ both by central difference quotients: 


U; na =U; pa — 0:5 + 7(U, «) (Uj, — G-1,]- (4.22) 


Starting values are now required on the first two rows (k =0, k =1). 
The values on the row k =1 can be found from 


Uji— U1 =2u,, U,—2U 5+ U, 1=Puy,, 


which yield 
U,1=U, otlu,+ Zhu, (4.23) 


(the beginning of the Taylor series). The derivative u,, can be calculated 
in the same way as for the power series expansion of § 4.3; in fact the 
required formula has already been derived as (4.19). Since ® becomes 
infinite when x = 4, this formula cannot be used for the value at x =4, 

=1; thus Ug, must be calculated by some other means, and in 
Table IV/16 the value found by the cruder method is taken over. Here 
also an unsymmetric formula [corresponding to (4.21)] must be used 
at the boundary: 


Up p41 = Uy n-1 0) + (Up x) f= OT ie 4U,; = U, x]. 


The errors in the results obtained by these two finite-difference 
methods are given in Table IV/17 (the exact values were calculated 
from the characteristics by interpolation). It can be seen that the errors 
are smaller for the second method than for the first, as was to be expected. 


4.5. Iterative methods 


An iterative process can be defined by solving the given differential 
equation (4.1) for one of the partial derivatives, say 2,: 


Ou 
Py = G(u, x4, eeey Xn» de, 2p ONG 
On, 
and replacing « by wt"! on the left and by u'*! on the right. Thus the 
next approximation “+” is determined from the current approximation 
wu") by solving the differential equation 
[e+] cualk | aylt! 
os Gi ul*) a 7 ee <~ 
Ox, ON, Os, 


316 IV. Initial- and initial-/boundary-value problems 


for a function w**1) satisfying the initial conditions prescribed for u 
(this method may not always be suitable or even possible). In propa- 
gation-type problems the variable corresponding to time will be taken 
as %. 

Accordingly, with / defined as in (4.18), the iteration formula for 
the differential equation (4.13) of the example in § 4.2 reads 


ayltth 
at 


aultl 


==a+/(u™) = 


A first approximation can be found by solving the initial-value problem 


4—% 


ay! ay! 
a = 
5S-—* 


— [0] = ==) - 
ae aoe (x, 0) =@(x) =2 


whose differential equation represents a constant-coefficient approxima- 
tion to (4.13). This simplified equation admits of a general solution 
expressible very simply in terms of an arbitrary function w: 


ull (x, 2) = —at+w(x+atl). 


The initial condition implies that w=g, so that finally 


ull(x,t) = —at+o(x+ae) =2-— ahs, 
Se ee 
With 
fo) _ Gul) a 2 

a near a 

(=) 

the equations for the next approximation [1] read 

uf! = —a + f(ul™) uf), wlll(x, 0) = (x). 


For a given value of x, u{*! can be immediately tabulated at intervals 
A in t, then ul) calculated by numerical integration. In Table IV/18 
this is done with h =} for the values of x used in the finite-difference 
methods in § 4.4. The values of «w! for ¢=1, 2,3,... are calculated 
by Srmpson’s rule and the intermediate values for t=, 4.4... by 


the formula 


f e(x)dx mm %[5e(0) +88(h) — g(2h)] 


(for the rows with ¢=1 only the results are given). The errors in the 
values of u!® and ul") are also given in Table IV/17. 
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4.6. Application of Hermite’s formula 


Another method has been suggested by Prranz!; it utilizes HERMITE’s 
generalization of TayLor’s formula (Ch. I, § 2.5). For the sake of simplicity we 
describe the method for a differential equation 


F(z, y,uU, Pp, q) =0 (4.24) 


in only two independent variables x, y (here p= 0u/0x,q=OGu/dy). Let U;, P,, QO; 
be approximations to u, p, g at the point = %,, y= y, and U, P, Q corresponding 
approximations at the point 4%, y. Then (2.60) of Ch.I with k=m=1 and 
4%, V1, %9, Vg, h, R replaced by y, y, ¥j, Vj, h;, kj, where h;= % — %;, k= v7 
yields 


hy ky hj kj 
U = a ey + ar, (4.25) 


eS 2 

Now let %9, Yo, % and %,, ¥,, %, be two points on the initial curve; then U,, P,, 
Q), U,,PR,, Q, are known. If we write down (4.25) for 7=0 and j7=1, and also 
demand that U, P, Q satisfy the differential equation (4.24), i.e. 


F(z, SUS Q) 0p (4.26) 


then we have three equations for the three unknowns U, P, Q. P and Q can be 
expressed linearly in terms of U by means of (4.25) with 7=0 and 7 = 1, so we are 
left with (4.26) to solve for U; this is usually done iteratively. 

As long as the computational labour does not become too great the method 
may be extended to higher approximations by using (2.60) of Ch. I with k = m= 2. 
Cu Cu Ou 
“0x8 Axdy’ Oy? 
MITE’S formula has to be written down for three points on the initial curve: 


Approximations R, S, T to must then be included and HEr- 


12U — 6(h;P+Q) +hjpR+ 2hjkyS +APT 


i = 0, 1,2). 4.27 
= 12U;+ 6(h; PB +k; Q)) + R+ eel ( ) tae) 


The system of equations for U, P, Q, R, S, T is completed by (4.26) together with 
the two equations 


Rt hP+HRR+ES=0, BRthQ+KS+HET=0. (4.28) 


§5. The method of characteristics for systems of two 
differential equations of the first order 


In this section we describe briefly the elements of a characteristics method 
which has been used extensively for hydrodynamic and aerodynamic problems but 
mostly in graphical mode. lor the details, in particular, the exploitation of various 
advantages afforded by graphical treatment?, and also for more extensive problems §, 
the reader is referred to the literature. 


1 PrLanz, E.: Bemerkungen iiber die Methode von G. DuFFING zur Integration 
von Differentialgleichungen. Z. Angew. Math. Mech. 28, 167 —172 (1948). He also 
gives a numerical example. 

? Massau, J.: Mémoire sur l'intégration graphique des équations aux dérivées 
partielles. Gent 1900; for a description of the method see in particular §§ 5,6 
Ch. III, pp. 46—58; the method is applied to numerous hydrodynamic problems. 

3 CourAnT, R., and D. HiLBertT: Methoden der mathematischen Physik, Vol. IT, 
p. 303 et seq. Berlin 1937. — Sauer, R.: Charakteristikenverfahren fiir die ein- 
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When carried out numerically, the method has a certain resemblance 
to the finite-difference method, but unlike that method it has the 
important advantage (cf. § 3.1) that it builds up an accurate approxima- 
tion to the true determinate region of a given initial segment. 

We shall consider a system of two quasi-linear differential equations 
in two dependent variables (x, y) and v(x, y), i.e. a system of the form 


AU, + Ag, + ag, + ay y=A, 
bu, + b, uw, + byv, + bv, = B, 


where a;,b;, A, B are given functions of x, y, , v. 


(5.1) 


5.1. The characteristics 


Let us begin by considering the problem of calculating u and v in 
the neighbourhood of a curve C on which their values are prescribed. 
Imagine curvilinear co-ordinates 
€, 4 introduced in such a way that 
one of them, say &, is constant 
on the given curve C (Fig. IV/19). 
We shall assume that in a neigh- 
bourhood of C the co-ordinate 
transformation (x, y)—>(&,%) is 
one-one, i.e. the Jacobian of the 
transformation is non-zero: 


atén)__ | Fx si 


@D = - (5a) Fig. 1V/19. Introduction of the characteristics 


24.9) — | neny 


uw and v are known on C and hence also are their derivatives M50, 
along C. We now try to determine the values of the other derivatives 
u,,v,; on C. Substituting 
U, = UE, + Uy), 


dimensionale instationare Gasstroémung. Ing.-Arch. 13, 79—89 (1942). — ScHULTz- 
Grunow, F.: Nichtstationare, eindimensionale Gasbewegung. Forsch.-Arb. Ing.- 
Wes. 13, 125—134 (1942). — Sauer, R.: Charakteristikenverfahren fiir Kugel- und 
Zylinderwellen reibungsloser Gase. Z. Angew. Math. Mech. 23, 29—32 (1943). — 
Theoretische Einfithrung in die Gasdynamik, p.146 et seq. Berlin 1943. — 
Oswatitscu, Ki.: Uber die Charakteristikenverfahren der Hydrodynamik. Z. 
Angew. Math. Mech. 25, 195—208 (1947); 27, 264—270 (1947). (A comprehensive 
review.) — Courant, R., and K. FrrEpRICHS: Supersonic flow and shock waves. 
New York: Interscience Publishers, Inc. 1948. — SavER, R.: Dreidimensionale 
Probleme der Charakteristikentheorie partieller Differentialgleichungen. Z. Angew. 
Math. Mech. 30, 347— 356 (1950). — Anfangswertprobleme bei partiellen Differential- 
gleichungen, p. 229 et seq. Berlin-Géttingen-Heidelberg 1952. — Hyperbolische 
Probleme der Gasdynamik mit mehr als zwei unabhangigen Veranderlichen, 
Z. Angew. Math. Mech. 33, 331—336 (1953). 
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and corresponding expressions for u,,v,,v, into (5.1) we obtain 


(4, &, + dg Sy) Me + (ag S, + Ay &,) Ve 

= A — (49, + 42 My) Uy — (ge + Ga Ny) Uy, 
(0, &, + 0. &,) ue + (by &, + by &,) Ue 

= B— (0,9, + 52 ny) u,, = (637, + 54 ny) v,- 


Thus we have two linear equations for the unknown values of u, and 
v, on C. If the determinant of coefficients 


= a §,+ a.é, a,€, + ag&, 
Cie. + Ople, 63 € + Ugew 


does not vanish, u, and v; may be calculated. Then in the first instance 
the values of uw and v at neighbouring points ( +’, 7) for sufficiently 
small €’ can be approximated quite crudely by the first-order terms of 
their Taylor series. 

If, however, the determinant A does vanish along C, then the values 
of u and v at neighbouring points cannot be so calculated. A curve 
&(x, y) =constant along which A vanishes identically is called a charac- 
teristic. In general this ‘‘characteristic’’ property depends on the par- 
ticular solution u,v, so that, unless certain simplifications obtain, we 
can only speak of a curve as a characteristic with respect to a specific 
solution u,v. These characteristics form the basis of the approximate 
method to be described; we therefore derive now several of their proper- 
ties which will be needed later. It is convenient to introduce a notation 
for certain determinants which will appear in most of the formulae: 


(5.3) 


(5-4) 


aj, = 4,6, — ad, A, =aeheb, — Bitty  , Razznition eater: (585) 
thus the determinant (5.4), for instance, can be expressed in the form 
A = a 562 + (414+ ays) &,&, + Gaaey: (5.6) 


Let y be the angle between the tangent to a characteristic £ =constant 
and the x axis, so that 


tany = — 3 2 (5.7) 
kd 
The equation 4 =0 yields a quadratic equation for tan y, namcly 
a, tan?y — (a,4+ a5) tany + a,4=0, (5.8) 
from which we obtain the two values 
_— et Gag D 
tany = ut tnt? | (5.9) 


where 
D? = (ay 4+ dag)? — 44,5 ag. (5.10) 
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In the following we assume that D?>0 so that there are two real 
values for tan y. The system of differential equations (5.1) is then called 
hyperbolic with respect to the solution u,v. For a given solution 4, v 
we therefore have two values of tany, say tan y, and tan VY, at each 
point (x,y) and hence two corresponding (‘‘characteristic’”’) directions 
whose direction ratios satisfy the equation 4 =0. Thus we have two 
“direction fields’, each of which generates a one-parameter family of 
characteristic curves. We assume for the remainder that € =constant 
and 7 =constant are the two families of characteristics. 

The equations for the characteristics do not depend explicitly on the 
functions A, B and they depend on u and v only through the functions 
a;,b;. If the latter depend only on x and y, the characteristics can be 
determined from (5.9) without reference to a particular solution and thus 
constitute two families of curves which, for a given system (5.1), are 
fixed once and for all, and are independent of any boundary conditions 
which would be needed to specify a particular solution. 

We now note for later use some algebraic transformations. By 
expressing the following determinant in terms of the second-order sub- 
determinants which can be formed from its first two rows, and using 
the fact that its value must be zero since it has at least one pair of 
identical rows, we obtain 


| 4 Ay Az ay 
4 | 0, by By bg) 
ue —= —_— =), mal 
2 | dy dy dg ay Ay 2 Ag4 — Ag An4 + G4 Qo (5.41) 
1B, be by 0,4! 
By virtue of this identity, (5.10) can be put in the form 
D? = (ag3 — &4)® — 40,9 gq. (5.12) 


The expressions (5.9) for the two values of tan y differ from each 
other only in the sign of D; we associate them with the two families of 
characteristics with angles y, and y, (Fig. 1V/19) as follows: 


tany = — §s = - 2am -—— = S14 putea D 

y gy 44+ a,,—D 2413 (5.13) 
tan y ee Des —_— 256 — Aya t 43— D i 

; Ny A4+ 43+ D 2413 


The equivalence of the two alternative expressions given here can be 
verified immediately using (5.10). 


5.2. Consistency conditions 
Along a characteristic, say € =constant, there exists a certain relation 
between the values of w and v. This relation, which is, of course, a 
consequence of the characteristic condition, is established as follows. 


Collatz, Numerical treatment, 3rd edit., 2nd print. 21 
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In a region of the (x, y) plane in which wu, v and their partial derivatives 
are continuous u, and v, have specific finite values satisfying the con- 
ditions (5.3), and therefore, since the determinant A [(5.4)] vanishes 
when & =constant is a characteristic, the right-hand sides of (5.3) must 
satisfy the usual consistency conditions along a characteristic; these 
conditions yield, in fact, a linear relation between the values of thy 
and v,; for example, the condition that the determinant corresponding 
to u, must vanish, namely 


A, ze el (41, a ayy) oa (439, + 44Ny) Uy a36, + a,é,| = 


=O, (rrr 
(Oe be Ny) u, — (03 9, + b4n,) Vy b3E, + by é,| 
yields the relation 
A,&, + Age, — u, (3&9, + 4146, Ne + G25 6.7, + (5 45) 
+ a4 &, Ny) + V, 434 == 


in which we have used the notation of (5.2) and (5.5). 


The factor multiplying w, here can be simplified using (5.7) and (5.8): 
with y= y, along = constant we have 


Sy i a, tany, + 44) + Tie a, tany, + Gy 4) | 
= ,[n,(— 43 tany, + 4,4) +n, tan y,(— a5 tan, + a,)] 
= (n. — Ny S (— a5 tan y, + 44) = D(a,, tan y, — a,). 
Then, after division by a3,, (5.15) becomes 


Ace 
Dv,—m Pu, + “ = % aU: (5.16) 
where [from (5.12), (5.13) ] 
— 3taANyy— Aye _ —F%gt 43+ D _ 2419 
= as4 2434 — 44+ 43—D~ vale 


Now let the arc length s be introduced as parameter on the charac- 
teristic € =constant; then 


dv _ dv dn d 
‘ds = én ‘ds. = v, (Hs x, oh Ny 4) = v, x; (ns si Ny A 
5 &y 1n¥s 
=U, %, (nz Ny €) = oS @, 
and similarly 
du yds 
i= = 5 ®; 
also 
%,=cosy, and — = = tany, 
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so that from (5.16) we have finally 
( dv du 


dv du Ee A, 
is ier a Ort ee a trees 71 (5.18) 


For a characteristic of the other family 7 constant, D is to be 


replaced by —D; hence we have (using the same symbol s to denote 
the new arc length) 


dv we, du cater A, és ‘A; 
(is ~ Fs rmemet = aN t Sh cosy, (5.19) 
where 
2434 — 444+ ag3+D ° 


Thus along the characteristics the values of u and v must satisfy the 
conditions (5.18), (5.19), respectively, while along curves on which A +0 
uw and v are not related in this manner. 


5.3. The method of characteristics 


We suppose now that the values of u and v are given on an arc of 
a curve A, which is nowhere tangent to a characteristic. We may 
suppose further that the values of u (say) alone are given on a contiguous 
arc K, which is likewise no- 
where tangent to a character- 
istic and which makes with 
K, at their intersection P an 
angle which includes just one 
of the characteristics passing 
through P (see Fig. IV/20). 

Let B and P, be two points 
on the curve K, and let the 


characteristic = constant 
passing through Pf, intersect 
the characteristic y= constant Fig. IV/20. Determinate regions 


passing through P, at the 
point P, (Fig. 1V/20). We do not yet know the position of FB, but if BR 
and P, are sufficiently close together we can use the point of intersection 
of the tangents to the characteristics at P, and P, as an approximation 
to it. Further, we can approximate to the equations (5.18), (5.19), 
which hold along the respective characteristics, by replacing the deriv- 
atives by difference quotients for the steps s,=/, 2, and s,= P, P,, 
respectively. In this way we obtain two equations for u, and v3: 
(3 — 04) — 91 (43 — %) = — = (Ajsiny,— A,cosy), (5.24) 
(Ys — V2) — Yo(%3 — Mg) = — ri (A,siny,—A,cosy_). (5-22) 


Ot 
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In similar fashion we can calculate values for u and v at all points 
of the approximate characteristic mesh within the determinate region 
of the arc K, (the curvilinear ‘‘parallelogram’’ shaded in Fig. IV/20), or 
rather within the polygonal approximation to this region outlined by 
the approximate characteristics through P and J. 

If, as mentioned at the beginning, we also have values of u prescribed 
on the curve K,, we can start say at P, in Fig. IV/20 and use the equation 
corresponding to (5.22) for P,, B to calculate the missing value v, from 
the known values “,, v,,¥;; the next interior point can then be treated 
as above, and in this way, using just the one equation whenever we have 
to deal with a boundary point, we can proceed to fill in the region 
between K, and the enclosed characteristic through P. 

We can improve somewhat on the approximation represented by 
(5.21), (5.22) by using one of the methods of the second chapter for the 
integration of (5.18), (5.19), such as one of the simple methods of § 1.5 
of that chapter. We can also improve on the approximate position of 
P, by using, for example, the principle of the Euler-Cauchy method: 
firstly, a provisional approximation is calculated by the method described 
above, i.e. the intersection of the tangents at the points P,, P, is used 
as a provisional position P, for the point P, of the characteristic mesh 
and corresponding values #,%, for us, v3 are calculated from (5.21), 
(5.22); from these are calculated corresponding approximations 4,, 3/2 
to the characteristic directions at P, (see Fig. IV/20); then the inter- 
section of the new straight lines through P, and P, making the angles 
(w+) and $(yet+ 2), respectively, with the x axis may be expected 
to give a better approximation to the position of P,. A simple method 
from which better values for « and v may be expected is to use now the 
mean values 4(u,+%3), 3(v, +03) for # and v in the nght-hand side of 
(5.21) and correspondingly for (5.22); effectively, we write down (5.18) 
for the mid-point of P, P, with these mean-value approximations for the 
local values of u and v, and correspondingly for (5.19), and replace the 
derivatives by central difference quotients. 


5.4. Example 


We choose a particularly simple example with differential equations 
admitting of predetermined characteristics and for which the exact 
solution is known so that the error in any approximation is also known. 


The current J(x, ¢) and potential J’(x, ¢) in an electric cable satisfy 
the equations 


CY 4. Sitemap Rimage ® (5.23) 


ot Cx Ct ax’ 
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where ¢ is the time, x is measured along the cable and C, R, L, S are the 
usual symbols for capacity, resistance, self-induction and leakage (per 
unit length of cable). 

Let us consider the case S =0. 
Then with «= J,v=—CV,t=y, 
LC =a?, RC=8 the differential 
equations become 

u,—v,=0 
—au, +o, = pu. 
Here the matrix of the coeffi- 
cients a;,b;, A, B in (5.1) reads 


Yet Jd 


| (5.24) 


5 ee) v1 0 

0 —a«? +41 0 Bu 0 2cr 
an d the v. alues of the de ter- Fig. IV/21. The foe ee. Pa ai a of 
minants (5.5) are 

Qe=—e, g=1, qe=A23=0, Agg=— a7, ayy=1, 
A,=0, 4,= 64. 
From (5.10), (5.13) we have 
D?=40, D=2a, tany,=a, tany,=—a, 

so that the characteristics are the straight lines y +-« x =constant; they 
are independent of boundary conditions and particular solutions. 

If, for convenience, we measure the arc length s from the initial line 
y=0, we have cos y,= — cos y»=(1-+«?)—?; then, since ¢,=«, g,= —a 
from (5.17), (5.20), the relations (5.18), (5.19) which hold along the 
characteristics read 


ag = ai 
ds ds Jencomt  Vacpat (5.25) 
du du 1 
an 
ds ds }y=const V4 + a? 


If we write down these equations for two points A, P, lying on a 
parallel to the x axis a distance 2A apart (Fig. [V/21) and replace the 
derivatives by forward difference quotients, we obtain (with function 
values at the points P in Fig. IV/21 denoted by 4,, v,) 

V3 — Ve— &(Ug— Uy) =ABug, V3— Vy +a(Ug— U4) = —AB uy, (5.26) 
and hence the first crude approximations 


Vs = $[(¥1 + 2) + (a — Bh) (4, — U2) |, 
os = [(v1 — ve) + (a — Bh) (my + M2) ]. | 


20. 
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We can approximate equations (5.25) rather more accurately by 
writing them down for the mid-points of PB, P, and P, P,, using the arith- 
metic means of the end-point values for the function values at the mid- 
points and replacing the derivatives by central difference quotients: 


Vg — Vg — & (Ug — Up) =hp a=, 
(5.28) 
Vg — 01 + & (4g — %) = —hB at, 
Solving these two equations for u;,v,; we obtain the approximations 


5 = 4 |(o +02) + (2 — FP) (a —)], 


Ms = sore | (4 2) + (a —&) (4 +) . 


2 


(5.29) 


We now consider a particular problem with the initial and boundary 
values 


ee. 
sel, 0) eget for 02a 2 
oe; 0/0 


“(0,y) =«“({2,y)=0 for yZ20. 


From (5.27) and an appropriate boundary formula, « and v can be 
calculated row by row for y=ah, 2ah, 3ah,.... Since « is given on 
the boundary, the appropriate formula to be used to complete each row 
at the boundaries is the second formula of (5.26); for the boundary at 
x =O, for instance, we use 


Us = Ug — «(U5 — %,) —ABu,, 


in which the subscripts refer to the points P,. P, situated as in Fig. 1V/21 
and the value of u; is given (zero in the present example). Since sym- 
metry (or antisymmetry in the case of v) exists about the line +=1, 
we can restrict the calculation to the half O<..+<1. The results obtained 
with #=1 for the case «a =2, B=1 are exhibited in Table IV/19. The 
value of uw for each mesh point is given with the associated error (in 
fifth-decimal units) in brackets and the corresponding value of v im- 
mediately below. The error was obtained by comparison with the exact 
solution 

1 
v 


u(x,y) =e-Ysin™ xfeos?” —1 sin?”|, where » =V4a?— 

(x, 9) a : ak y= Var? — 1. 
The last column of the table is a check column containing row sums, 
the summations being extended over the whole row 0S x52 for u but 
only over the half row 0< +<1 for v (the sum of all v values for OS 72 
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is zero and therefore does not provide a check). The check consists in 
verifying the relation 
8S = 7 Om_— Ya) — 4, 


(where , and v, are the first values of « and v appearing in the m-th 
row), which should hold between successive row sums S,,, Sin41 Of the 
uw values. 

Table IV/20 gives the beginning of a similar calculation based on the 
finer characteristic mesh with h = +4 and Table IV/21 gives the beginning 
of a calculation based on the coarser mesh with h=+ but employing 
the more accurate formulae (5.28), (5.29). Again the errors in the u 
values are given. The gain in accuracy over the first rough calculation 
is slight. 


§6. Supplements 


In §§ 6.1 and 6.2 we prove theorems which permit the deduction of bounds for 
the error in approximate solutions of various problems in parabolic differential 
equations. These theorems play a role for parabolic equations similar to that 
played by the boundary-maximum theorem for elliptic equations (Ch. V, § 3), which 
likewise provides a possible basis for the estimation of the error in approximate 
solutions. Rather less is known about hyperbolic differential equations in this 
respect; a theorem has been established! which states that under certain conditions 
the maximum of a function satisfying a differential inequality is assumed only 
on a boundary curve, but the cases covered by the theorem do not yet possess 
the degree of generality which has been achieved for elliptic and parabolic equa- 
tions. Nevertheless, it is worthy of note that an error estimate is possible for 
the “‘mixed-type’’ problem with equation (1.57), which was mentioned in § 1.9 
(the Tricomi problem). 


6.1. Monotonic character of a wide class of initial-/boundary-value 
problems in non-linear parabolic differential equations 


A very general estimation theorem which nevertheless admits of an 
elementary proof has been established by WESTPHAL?. Let B be the 


open region 
Oya Y, xy) er=aay{y), 


1 Acmon, S., L. NrrENBERG and M. H. Protrer: A maximum principle for a 
class of hyperbolic equations and applications to equations of mixed elliptic- 
hyperbolic type. Comm. Pure Appl. Math. 6, 455—470 (1953). — PRotTer, M. H.: 
A Boundary Value Problem for an Equation of Mixed Type. Trans. Amer. Math. 
Soc. 71, 4146—429 (1951). 

Some applications to error estimation for hyperbolic differential equations will 
be published shortly by the present author; cf. also L. CoLttatz: FehlermaB- 
prinzipien in der praktischen Analysis. Proc. Internat. Congr. Math. Vol. I, 
Amsterdam 1954. 

2 WeEsTPHAL, H.: Zur Abschatzung der Lésungen nichtlinearer parabolischer 
Differentialgleichungen. Math. Z. 51, 690—695 (1949). — Similar and more general 
theorems can be found in the following papers: — Piconr, M.: Sul problema della 
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where Y is a positive constant and x9(¥), x,(v) are two given continuous 
functions of y such that x9(v)<.,(v) for OSS Y (see Fig. IV/22). 
We shall need to distinguish between 
that part of the boundary of B which 
lies along the line y=Y and the 
remaining part; we denote them by 
Jy and I, respectively. Now let T be 
the operator defined by 


¥ 


(ez 


i 


> Tu =u, — f(x, 9, %, %,,%,,) (6.4) 


Fig. 1V/22. Boundaries for aclass of boundary for functions w(x, ¥) which are con- 
Nimans art partner] Parabolic tinuous in the closed region B=B+ 
I+ Jy and for which #,, «,, 4,, exist 

in B. If we restrict the given function /(x, v, «, u,, 4,,) to be monotonic 
non-decreasing with respect to u,, for any fixed values of x, v, 4, 


then the following theorem holds. 


a0 


Theorem: J/, with the above definitions and restrictions, two fune- 
tions 4 and v are such that Tvu<Tu in B+ TI). and v~u on I, then 
v<u throughout B. 


Proof: Let w=«—v; then w>0 on J’ and we wish to show that 
this is true also in B+ J\.. Let M be the set of values of vino<SvSY 
for which there is at least one value of x in x¥9(v)\ vs. 4, (¥) with eS; 
we wish to show that this set is null. Suppose that it is not. If it is an 
infinite set, 1t will have a lower limit ? and there will be a sequence of 
values v, with corresponding values x, such that v, +f and w(x,, v)S0; 
now these x, form a bounded infinite set, which must have a limit f, 
and we can choose a sub-sequence 4;, with corresponding values ¥, 
such that the points (1, ¥;) converge to the limit point P= (t, 1); 
then by continuity w (P) >0. 1f.M is finite, we take the smallest member 
of M as # and a corresponding x value as *. Now P cannot lie on J”, 
so we can choose a sequence of points (7, v) with #0 which tend to 
P from below (Le. with 198d); henes, by eontinaity, w (P) TO and we 


must have w (P) — OF we sev also that w, (2) 0 (2, is assumed to exist 


propagazione del calore in un messe di frontiera conduttore, isotrope e anogenes. 
Math. Ann. 101, 701—712 (1929). — MarastmHaNn: On the Asymptotic Stability 
of Solutions of Parabolic Differential Equations. J. Rational Mech. Anal. 3, 
303— 313 (1954). — NIRENBERG, L. A.: A Strong Maximum Principle for Parabolic 
Equations. Comm. Pure Appl. Math. 6, 167—177 (1953). — Szarsktr, L.: Sur la 
limitation et unicité des solution d'un systéme non-linéaire déquations paraboliques 
aux derivées partielles du second ordre. Ann. Polonoci Math. 2, 237 —249 (1955). — 
Cotvatz, L.; Behlerabschatzungen fur Naherungslésungen parabolischer Differen- 
tialgleichungen. Anais Acad. Brasileira de Ciéncias 28, 1—9 (1956). 
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in B). Similarly, w=0 on the whole line segment ya), eg V) ae, (9) 
and therefore, since w, and w,, exist at P, 
w,(P)=0, w,,(P) 20. 
In terms of wu and v the situation at P is that u=v, U,=V,_ UySv,, 
Uy y= Vz,; Consequently 
[Xs Wee Hee) a V3 0, 0, ¥-,) “and Tas Ty, 


which contradicts our definition of « and v. Thus the set M must be 
null and the theorem is proved. 


6.2. Estimation theorems for the solutions 
In the reference cited, WESTPHAL makes among others the two 
following applications of the theorem in § 6.1. 
Theorem 1. With the definitions of § 6.1 let there be constants &, &, 6 
such that 
|\Tulse, |Tv)se, im B+Iy and |u—v|S6 on T; (6.2) 
further, in addition to the monotonic condition of § 6.4, let f satisfy 


| t(x, Y, Uy, Uy, Uy x) a f(x, Y, Ug, Uy, Uy x)| = Cr (6.3) 
where C* is a constant, for all values of x, y, U, U,, U,, which come into 
consideration. Then 

2 ju —v] Sd6+ (C*+ 4+ &)y (6.4) 
in the whole of B. 


Proof. Again let w=u—v, and apply to it the operator T* defined 
for fixed v by 
i? Py I(x, Y, U,V, =F Px. UP a Dex) + f(x, Y,U, Uz, v,.): 
we have 
T* w =U, — Vy —f (%, YU; Uys Mex) +H(%, YU, Uns Ves) 

= Tu— Tot (%, ¥, 6, Ue, Mee) — f(%, I, 0, Uys Mee) 

Se+e,+C* 
in B+ J. Now the function defining 7* @ is a monotonic non-decreas- 
ing function of g,,, so that 7* has the same monotonic property as was 
prescribed for T in § 6.1; moreover, the function W=6 Fe +(C*+¢,+ 
€,+¢) y, for which 


T*WeeC* snepetape oe, 
is such that T*w< T*W in B+J), and w<W on J for any positive 
constant ¢; consequently we can use the theorem of § 6.1 to show that 
w<W in the whole of B. Similarly —w<W, and hence |w|<W, in 
the whole of B. (6.4) follows by letting « tend to zero. 
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Theorem 2. Let the region B of § 6.1 be such that 
xy) =—-A, xO) 2A 


and in addition to the monotonic condition of § 6.4 let f satisfy a Lipschitz 
condition of the form 
[F(x y, w', 1, 2) — 1 (2, ¥, 0", Me He 2) | (6.5) 
<M, |u' — «| + M, |ui,— 47 +M,|u,,—%;,\|- 
Then for two functions u,v satisfying the differential equation Tu= 


Tv=0 in B+Iy and which are equal on that part of the boundary I 
along y=0 and differ by at most 6 on the remainder of I’, we have 


| = v| <b elMet+ Mit 2M) y—A (e!! +2) (6.6) 
in the whole of B. By putting 6=0 we obtain the uniqueness theorem for 
the first boundary-value problem. 

Proof. Again let w=u—v, but this time consider the operator 


T* p = 9, —M,|o| —M,|¢.| — Me, P(ez2), 
where 


(2) = 4 (2 +1) = 


ioe Feo 
0” ton2 <0 


@(z) is a monotonic non-decreasing function of =, so that 7* again 
satisfies the monotonic condition of § 6.1. 


Now 
th, — By = f(2, YH, gs Mes) — Fs Yo PDs Ves) 
=f (X,Y, Uy, Ver) — L(%, VV Ves Vex) + 
LH, Ys My Megs Mee) — FC, Ys My Mes Ver) 
<= M,|\v|+™M,|v,.| +4. 2(v,,), 
where we have used the fact that / is a monotonic non-decreasing func- 
tion of its last argument. Hence 7*w<0. 
For the function 


ie = db el(Mot Mit 2Mi+8)y—A (el*l + 4¢7 #14) ; 
where € is any positive constant, a simple calculation yields 
T*w = 6 (Mot Mit 2Mi+e)y ~A x 
x [e(el*lt de-Pl+l) + 3M, e-Fl14 M, (el*l — e~7I41)]. 


Consequently T*W>0> 7*w. Since we also have W>w on I, it 
follows from the theorem of § 6.1 that w<<IWW in the whole of B. By 
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interchanging « and v we can show also that —w<W, and hence 
|w|<W, in the whole of B. (6.6) follows by letting « tend to zero. 

GORTLER! has considered such estimation theorems generalized for 
the solutions of the system of partial differential equations 


uu, +vUU, = f(x, U, ty , Uy y) 
4,+v,=O0, 
which is of great importance in fluid dynamics. 
Example. Consider the example of 52th — 8 4): 
T#=4,—4u,,—1=0 in |[x|<1, y2o (ae) 
u(x,0)=0 for |x|<1, u(+1,y)=0 for y=o (boundary I’). 
The function 


N 
u(x, y) =3(1— x) + )a, cos (c,, %) e~%Y, 
~—a 


where c,,=(n —)x, satisfies the differential equation Tv =O and the 
boundary conditions v(+1, y) =O (for y=0) for any integer N and for 
arbitrary constants a,. From Theorem 1 with & = €g=C*=0 it follows 
that |# —v|<6 in the whole of B, where 6 is an upper bound for |u—v| 
along the initial line segment y=0, —1<xSX1. We therefore choose 
the a, so that 


N 
ja (4 — x*) + a, cos(c,x)| <d 
n=1 
in the interval —1<x<1 with 6 as small as possible. For N =3 we 
can take 6 as small as 0-002 with the constants a, = —0-516, a, = 0-0193, 
a,—= —0-005. The Hermitian finite-difference method of § 2.4 yields the 
approximate value (0, *) ~ 110183 — 0.19253 at the point i =O, 
k=10 (since /=3 and a= 4). Here we obtain the approximation 
v(0, 2) =0-19158 and can assert with certainty that |% (0, +) —0-19158| 
0-002. This error estimate can be improved somewhat by the addition 


of a suitable constant to v. 


6.3. Reduction to boundary-value problems 


As for ordinary differential equations (Ch. II, § 5.9), initial- and 
initial-/boundary-value problems in partial differential equations may 
also be transformed into boundary-value problems, often in several 
different ways, and then dealt with by one of the several methods 


1 GOrRTLER, H.: Uber die Lésungen nichtlinearer partieller Differentialglei- 
chungen vom Reibungsschichttypus. Z. Angew. Math. Mech. 30, 265—267 (1950). 


334 IV. Initial- and initial-/boundary-value problems 


available for the treatment of boundary-value problems (Ch. V). The 
transformation is effected by raising the order of the differential equa- 
tion and adding further boundary conditions, which can often be chosen 
quite arbitrarily. 
Such a treatment of the heat-flow problem 
ou eu 
Ot CB” 
u(%,0)=4(0,4)=0, 4u(L,t) = 100 


is given in detail by ALLEN and SEVERN}. 


2 2 
They put on SO KS, so that Pw _ xe Hw 
* 


7 yD ae’ and as additional 


boundary conditions take 
é 
w(0,t) = w(L,t) = sr (x, T) = 0, 
where T is a suitably chosen time. This boundary-value problem for the rectangular 
region OS$*¥SL, OXtST they then solve by the finite-difference method in 
conjunction with the relaxation technique (Ch. V, § 1.6). 


6.4. Miscellaneous exercises on Chapter IV 


4. The numerical example of § 1.2 concerned the heat flow in a rod at one 
end of which the temperature was varied sinusoidally. After a long time (for 
large ¢) the temperature distribution settles down to a regular oscillation with the 
imposed frequency w. Calculate a half-cycle of this oscillating distribution by the 
finite-difference method [formula (1.13) with mesh width h=4 as in §1.2] by 
introducing the values U;,, on some row k=q (q assumed to be large and for 
convenience a multiple of 12) as unknowns 


Up, g=a, Upg=b, Usgg=e, 
expressing the U; ;, in the strip g<ASq-+ 12 in terms of a, b and c by means of 
na (1 + 4) and 
Ug. gt2s=0 for s=0,1,..., 5, and then determining a, b,c from the requirement 
that 


the formula (1.13) and the boundary conditions, say Ug 719;= sin 


Usr,g= —Use,gtig for r=1,2,3. 


2. Let there be initially a linear fall in temperature from 100° C to 0° C along 
a thin homogeneous rod of length 10. Then let the hot end be cooled rapidly 
while the other end is kept at 0°C. Calculate approximately the temperature 
distribution u(x, y) at several subsequent times y from the iitial- boundary-value 


problem 
aru Ou 
Oat = u(x,0)=10%, (0,9) =0, %(10,¥) = 100e—O1Y 


by means of the finite-difference method of § 1 with the mesh widths 4= 1 and }. 


3. In dealing with the heat flow in a thin homogeneous rod in § 1.2 we neglected 
radiation and convection effects. If we take into consideration a heat loss to 
the surrounding medium across the surface of the rod with the rate of loss of heat 


1 ALLEN, D. N. pE G., and R. T. SEVERN: The application of relaxation methods 
to the solution of non-elliptic partial differential equations. Quart. J. Mech. Appl. 
Math. 4, 209—222 (1951). 
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proportional to the temperature difference (or to the temperature u of the rod if 


we take the temperature of the surroundings as zero), then the differential equation 
reads 


where @, o, K, A are physical constants. If the rod (of length 2a) is initially heated 
to a uniform temperature u—=1 and then allowed to cool by itself, the initial and 
boundary conditions are 
u(x,0)=1 for —asrSa, 
Ou 


a 0 for *=+a and t>0. 


Calculate the solution of this problem for A=4, a=1, K=1. The introduction 


of the new variable y = ae reduces the differential equation to 
eo 


C2u Ou | 
Ox ay 2 


4. Use the finite-difference method to calculate an approximate solution of the 
cable problem which was treated by the method of characteristics in § 5.4, reducing 
the system of two equations for u and v to a single equation for u and similarly 
eliminating v from the boundary conditions. Compare the approximate solution so 
obtained with the exact solution given in § 5.4 and with the other approximate 
solutions obtained in § 5.4. 


5. Apply the ordinary finite-difference method to the problem 


Jut+thi=Jexsi J=0 for x=0 and #=1, 


= 

oy 445 _z; tor #=0, and 0<#<1 
i er: 

ot ax 


{transient current produced by an initially non-uniform charge distribution 
9o(¥) =e~* in an open circuit consisting of a thin uniform conductor] and in- 
corporate a running check. 


6. The free cooling of a long square prism from a uniform temperature in 
excess of that of the surroundings can be reduced to the problem 


Uyx+ Uyy=% in the region lahed,  |9] Sel, tao, 
u— £4 <9 on the boundary |v|=1, |y|/=1, #20, 
y 


and w«=1 for t=0. Apply the ordinary finite-difference method in the form of 
equation (1.56) of § 1.8, incorporating a current check. 


7. In § 1.8 we applied the ordinary finite-difference method to the heat equa- 
tion (1.50) with two space co-ordinates yx, y, and with the mesh widths (1.52) we 
obtained the formula (1.53), which depends on the parameter 9. The formula 
was shown to be unstable for 9 = 1, and the value 9 = } was recommended. Is the 


formula stable for 9 = 4? 


8. Let the two-dimensional wave equation 


Urey t Uyy= Cup, 


336 IV. Initial- and initial-/boundary-value problems 


be approximated on the mesh (1.51) with the mesh widths h,=hy=h, hy= (co)2h, 
by the difference equation 

U;, i,t41 == 2U;,n,1— Uinta + @(S — 4U;,4,0), 
where S is as defined in (1.55). Is the formula stable for g=1 and e=, re- 
spectively ? 

9. In § 2.2 several finite expressions of a higher approximation were derived 
for the equation u,,— Ku,=yr(x, y), K being a non-zero constant. With the same 
mesh notation as used there (mesh widths h, / with 1=oKh*) determine the quan- 
tities c and o in the expression 

B =U 1 — Uo — 9,0 — 2U,0 + U-1,0) + € 
so that ® is equal to a remainder term of the sixth order by expanding ® by 
Tay or’s theorem and using the relations 


atu ou 


eee aie. lan 


KR? uyy= 
where 
afr 
Sy=%etKry, Steen tb teary t yy: 
40. Derive in the same way as in Exercise 9 a finite expression with a sixth- 
order remainder term for the equation 


V2 = Uy t Uyy= Ku,+7(x,,?). 


6.5. Solutions 
4. The equations for the a, b, c read 
4131a+ 1406+ 91c= 229+ 92/3 = 388-35 
140a+ 12226+ 140¢= 88+ 60/3 = 191-92 
Ot1a+ 1406+1131e= 29+4+12V3= 49-785, 


Table IV/22. Half-cycle of the oscillating temperature distribution 


and since the matrix of coefficients has strongly dominant diagonal elements, 
they may be solved conveniently by single-step iteration; we obtain 


a = 0:3284, bSOAN9iF c = 0:0028. 


Table IV/22 shows the corresponding temperature distribution calculated from (1.13). 


6.5. Solutions 


387 


2. With the mesh relation (1.12) the finite-difference formula reduces to (1.13) 


and the calculation consists solely in forming arithmetic means. 


The results for 


h=1 and h=0°5 are given in Tables IV /23, 1V/24 and the temperature distribution 
is shown for various times in Fig. IV/23. 


Oo 7 @ 


oS mee 


Oo 8 a, 


Fig. IV/23. Temperature distribution « along the rod at various times y 


Table IV/23. Finite-difference approximation for the mesh widths h=1l=1 


20 40 | 

10 30 | 49-434 
| 20 139-717] 

10 | | 29°858) 48-262 
40 | 49-929) | 39-060] 

11 9-965] | 29-495 | 46°594) 
12 | 19-730 | 38-044 
16 18-870] | 35-473] 
20 17-460 31-522! 
24 15-711 | 27-722! 
28 13-854] | 24-010) 
32 12-026| | 20-584] 
36 10-326) |17°477 


Collatz, Numerical treatment, 3rd edit., znd print. 


| 58-867! 


| | 64-480) 


56-807; 


| 59-995] 


54-129) 
51-086 
| 44-323] 


| 37-993 | 
| 32-217 


27°091 
| 22°768 
| 18-934 


55°578 


| 63:183| 


| 57-027 
| 54-242, 


| 40°550) 
| 32-607) 
| 26°120; 


| 21-440! 
16°978 
113°578 


| 54-058 


| 46-907 


22 
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Table IV/24. A section of the results for the mesh widths h= i, t=4 


An deen, || Caen en NO 


[22 
88-781 | 90-484 

84-391 | 89-633 
60 70 79°695 | 87-012 86-071 

65 74-848 83°354 86:542 
60 69-924 79:101 | 84-948) 81°87: 

ve 49-996, | 59°926, | 69-432 77-249 80397 

39-995] | 49°045| | 59-658] | 68-484 | 74-802 75-654 |67-033 


3. We use the mesh 
a= (i— gh, Yp= hl 

with the mesh widths h = } and /= #5 [in accordance with (1.12)]. Then the finite- 
difference equation reads 

Us kta =} (Uit1,r = U;-1, es 
and the boundary condition (with = 5) 

Un, e+ Un+1,k ae Un4+1,k ae Unk 
2 h 


0-04 U;, R 


9 
CO ae 


=0, sothat U,s.2.= 


We need to use this boundary condition on the initial row » = 0 in order to calculate 
the value Ug 9 which is required for the calculation of U;,. If we had simply 
put Us 9=0, say, this discontinuity would have made its presence felt in large 
fluctuations in the U values, and the unevenness of the U distribution would 


Table IV/25. Temperature in a cooling rod by the finite-difference method 


0:99 
09801 
0-970 30 
0-960 60 
0:945 31 
0:93098 
0-91276 
0-895 65 
0°87620 
0°857 82 
0°83812 
0:81937 
0:79995 
0°781 36 


14. 0°28 


{0°99 
0:9801 
0-970 30 
0:949 23 
0:93555 
0:91315 
0-896 80 
0:87467 
0°85697 
|0°835 57 
10-81739 
0°79691 
(0°77877 
0°75925 


0:99 
0:9801 
0-947 57 
0:92948 
0°899 70 
0:88088 
0°85452 
0°83578 
0:81208 
0-793 67 
077204 
075411 
0-73413 
0°71678 


0°99 


10°81818 | 5 
|0:89909 |0°73562 |4-85909 |0-01000 


' Row-sum 
- check 
oK 


U, eer 
munus 
Us, k 


0-93465 |0:85382 |0:698 58 |4:72877 |0-055 35 
090761 O-SOSO08 0-66115 4:60380 0°-02704 
0:86875 0°77030 0°63515 445436 0-03886 

0:84420 0:74419 0-608 89 ,4:36895 0:02455 
O-B13 50 |o-71940 [6-688 35426761 | 0-030 70 


0-791 86 | |0°69373 | 0° 56759! 
0°766 21 |0:67279 \0:55047 
|0°74662 |0-65161 |0°53313 
0°72438 0:63336 051820 
0:70627 0:61496 0:50315 
0:686 44 |0°598 56 |0°489 74 
0:66947 0:58210 '0-47626 


0:65142 0:56704 ,0:46394 


4:14967 0:021 64 
4:045 10 |0:02565 
3-943 48 |0-01959 
3:84480 0-02224 
374878 0-018 11 
| 3655 38 |0-01983 
3°56442 0:01697 
3°47585 0:01805 
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certainly have been tar greater than that shown by the values obtained with 
no discontinuity (Table IV/25). The differences of the column i = 4, which 
are given in the last column of the table, show up this unevenness ; it is quite 
considerable initially but gradually dies away. The row-sum check to be satisfied 
by the row-sums recorded in the penultimate column is 


n 
Tr+1= (1 — 0-01) o,—FUyi,%, where ay = in 
i= 
4. With «= 2, B=1 the problem reads 
bee = 4tUy,y+ Uy, 


u(x,0) =sin ox 
WOE OE eS OD, 
Uy (¥ ja sin ay 
iS ey 
% (0, y) = «(2, y) =0 for OSy. 
With h=4, /=4 the difference equation reads 
Ui roa tr 16(Ui41,2+ U_1,2) —15U;, 4-1] (R= 0,1,2,...). 
To find starting values we must proceed as in (1.35) to (1.38); we obtain the formula 
Ui = ty (160,419 — ISU; 9+ 16U;_, 9). 
The first few rows of the calculation are given in Table IV/27, which includes 
7 
a row-sum check in the last two columns. If S,,= »} U; 4 is the sum of the U 
j=1 
values in the m-th row, then 
Tm = 17 Sm 4-y — 32 (Sip — Um) +15 Sy 


should be zero. The t values are very sensitive to small variations in the U values. 
The errors in the U values are given in brackets in fifth-decimal units. Initially 
their magnitude is substantially greater than that of the corresponding errors 
obtained by the method of characteristics in § 5.4. 


Table IV/26. Current produced by a non-uniform charge distribution 


0 0 0 |o i) 0 
0-2 0 0:15556; 0:12736] 0:10427| 0-08537| 0 0°23163} 0:47257 
0-4 0 | 0:12130) 0:24746| 0:20260| 0:09931| 0 0°45006| 0:67067 
ee | co” 0:09493, 0:19325, 0:23591; 0-11571, 0 042916} 0:63980 
0:8 0 | 0:07430) 0:09120) 0:11094| 0-13483] 0 0-20214| 0-41126 
1 0 0:00096| 0:00158| 0-:00182| 0:00096] 0 0:003 39} 0-005 32 
| % —0-065 72 —0-07986 — 0-097 96| —0-12026' 0 |—0-17782' —0-36380 
1-4 0 |—0-07693| —0-15731| —0-19223] —0:09416, 0 |—0-34954) —0-52064 
16 | 0 |—0-09036, —0-18409| —0-15087| —0-07428; 0 |—0-33496/ —0-49959 
22 | 0 0-09296| 0:07532| 0:06114| 0-05059] 0 0:13647| 0:28001 
28 | 0 0:04604/ 0:05705| 0:06886|} 0:08289] 0 0°12590| 0:25483 
3-4 0 |—0-04615 —0-09481° —0:11598 —0:05673, 0 |—0-21079; —0-31367 
4 0 | —0-001 82] —0:003 43| —0:00297| —0:00182| 0 |—0-00640] —0-01004 


Pgh 
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6.5. Solutions ; 341 
5. With 4= 0-2 the finite-difference equations read 
i : 
sx] (1 =, =) —th 
Jia 7 id 
Jikti= cog Witt Weeden yl (Ran 2)...), 


for which Me deduce the check 1-05 t,4,= o,+ t,— 0:95 Try, where o,= Jo p-+Jy x 
and t,= S J z- The results are given in Table IV/26, where only every third 
row is fe Peduced after the row k=8. 


6. With the mesh widths hy=hy=?,h,= 142 = 3 gs (and % = y)=0) the boundary 
condition is represented by oS 3,1 = 2U, 2,4: A convenient arrangement of the 
a shown in Table IV/28, which includes a column for the quantities 


= 2 Bs, &Uin., where the Bj, are the coefficients i) dee encircled at the 


ae 


beads ‘ot the columns and the summation extends over all mesh points (i, k) which 
occur in the table; these quantities are needed for a check, which consists in verifying 
that 

T4195), 


where 1; = 2, k,t Over all interior mesh points occurring in the table. 


7. Nos om should not be deceived by the fact that the absolute maximum of 
the propagated errors (set out below in the manner of § 1.8) decreases at first: 


l=0 l=1 i=2 l=3 
0 0 $e 00 —je 26 0 $e —ge te O 


[e]o] gejte] [Fe]—te a fe — be are 


8. For g=1 the formula is unstable!, while for g=1 we obtain the simple 
formula U; , 14;= iS — U;,p,1~-1, which is stable. 

A more accurate formula using more mesh points is given by MiLNE? on p. 144 
of his book. 


9. The Taylor expansion yields 


® : tog Bos a, é — on) 4 
Se ge pa) ges 8 ae 

au) B nS \ BP Ox ohS &u 

eed a3) Tees 306 oe 


where all values are taken to be at += y=0 except those distinguished by wavy 
lines, which are to be taken at certain intermediate points. The factor multiplying 
u,, vanishes, and so also does the factor multiplying v'u/éx4 if we choose o=t 


1 LyusTernik, L. A.: Dokl. Akad. Nauk SSSR. (N.S.) 89, 613—616 (1953) 
[Russian], gives the critical value Q (stability for 9 < Qo, instability for @ > @) 
for several finite-difference representations of the cna (1.54) for the heat equa- 
tion (1.50); @) depends on the smallest eigenvalue for the corresponding difference 


operator. 
? Mixng, W. E.: Numerical solution of differential equations. New York and 


London 1953. 
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ie. /=1Kh*. For this value of o we therefore obtain the finite equation! 


1 h? nt 
Uia= ra (U_1,0+ 4Uy 9+ Uy, 0) = 70,0 72 (Yx2+ Kry)o,0- 


40. With the notation for the « values in the plane =f =constant defined 
in Table VIII of the appendix, and using the results of that table, we find that 
for the mesh widths h,=h,y=h, hy=o Kh? 


Q = augt by mt ed ut pUul%, Yor bo + Mi) +4q 


= {a—porh?— £ gtnt(Ky,+V*7)} +ug(p+a+20] +h? V*u,[pot+6] + 
hA par h® 2 a 
ta! Mole era 1 ee te on BE n—V v)+ 


ns 
+ Ze (W8tq+ 2V2Dtta) +. 


Here we have put b= 4, e=1 in order that no term in Du, shall appear. If we 
put the three quantities in square brackets equal to zero, we obtain ~= — 36, 
o=i, a=16. Then the equation Q=0 yields? 


36U (4%, Vos to + 4K A?) = 16ug+ 42 up t Dd Me — Gh? 79 9 — 
— £h4(K7,+ V*r)o 9 + remainder term of the 6th order. 


This formula has index J =1 and is therefore stable. 


Chapter V 


Boundary-value problems 
in partial differential equations 


Many of the methods described for boundary-value problems in ordinary 
differential equations in Chapter III carry over without difficulty to partial dif- 
ferential equations. What has already been said in the introduction to Chapter IV 
about the need for more theoretical investigation and more practical experience 
applies particularly to boundary-value problems for partial differential equations 
and bears repeating here. For the solutions of these problems we do not possess 
existence and uniqueness theorems covering anything like the range desirable 
from the standpoint of technical applications; moreover, the diversity of problems 
which arise in applications is continually increasing. There is also an urgent 
need for existing approximate methods to be subjected to extensive practical 
tests and thorough theoretical investigations on a much larger scale than hitherto. 


§1. The ordinary finite-difference method 


The finite-difference method is applicable to boundary-value problems 
generally. The equations are easily set up and, 1f a coarse mesh 1s used, the 
solution is usually obtained to an accuracy sufficient for technical purposes 


1 MILNE (see last footnote) p. 122. For r(*, vy) = constant this formula includes 
the formula (2.10) with o=#. 
2 This formula is given by MILNE p. 137 for the case r=0. 
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with a relatively short calculation. M oreover, for partial differential equa- 
tions the finite-difference method may be the only practicable means of 
solution; for boundaries can occur of such shapes that other methods cannot 
cope with the boundary conditions at all, or at least, not without difficulty. 
If, however, the solution is required to a greater accuracy, the ordinary 
finite-difference method has the disadvantage of slow convergence and 
it is usually better to use one of the refinements of the method described 
in §2 rather than repeat the calculation with a smaller mesh width. 


1.1. Description of the method! 

Although the method may be applied to problems in three or more 
independent variables (cf. § 1.7), we will simplify the description, as in 
Ch. IV, §14, by restricting ourselves to two variables eGo 

As in Ch. IV, § 4, we introduce a rectangular mesh 


%,—=X%+th 
Ve=Yot kl 


and characterize function values at mesh points by corresponding sub- 
scripts (for instance, wu, , denotes u(x;, y,) and U; , denotes an approxi- 
mation to it). As in Ch. IV (1.8), we can associate with every partial 
Omtny 
Ox™ Oyn 
values at mesh points; thus, given any differential equation for u, we 
can derive in this way a corresponding difference equation, which pro- 
vides a relation between the approximate values U; ,. Such an equation 
is written down for every mesh point in the interior of the considered 
region. In a similar manner we derive difference equations corresponding 
to the boundary conditions, until we have as many equations as unknown 
values U;,. We can say nothing about the solubility of this system of 
equations without being more specific about the original boundary-value 
problem (cf. § 1.2). 


(1,2 =0, +1, +2,...) (124) 


derivative a difference quotient which involves only function 


1 The following is a selection of the extensive literature on the subject: 
RunceE, C.: Uber eine Methode, die partielle Differentialgleichungen V?u4= 
Constans numerisch zu integrieren. Z. Math. Phys. 56, 225—232 (1908). — 
RicuHarpson, L. F.: The approximate arithmetical solution by finite differences 
of physical problems involving differential equations with an application to the 
stresses in a masonry dam. Phil. Trans. Roy. Soc. Lond., Ser. A 210, 308—357 


(1911). — Lizsmann, H.: Die angenaherte Ermittlung harmonischer Funktionen 
und konformer Abbildung. S.-B. Bayer. Akad. Wiss., Math.-phys. Kl. 1918, 
385—416. — Hencxy, H.: Die numerische Bearbeitung von partiellen Differential- 


gleichungen in der Technik. Z. Angew. Math. Mech. 2, 58— 66 (1922). — CouRANT, 
R.: Uber Randwertaufgaben bei partiellen Differentialgleichungen. Z. Angew. 
Math. Mech. 6, 322—325 (1926). — Courant, R., K. Friepricus and H. Lewy: 
Uber die partiellen Differenzengleichungen der mathematischen Physik. Math. 
Ann. 100, 32—74 (1928). — Marcus, H.: Die Theorie elastischer Gewebe und ihre 
Anwendung auf die Berechnung biegsamer Platten, 2nd ed. Berlin 1932. 
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Since the practical derivation of the difference equations has already 
been treated in detail for similar cases (§ 1 of Ch. III, §§ 1, 2 of Ch. IV), 
there is little point in pursuing it further here; suffice it to explain the 
application of the method by means of the simple examples in §§ 1.5, 
1.6. In §§4.2 to 1.4 we consider a special class of problems for which pre- 
cise assertions can be made concerning convergence and error estimation. 


1.2. Linear elliptic differential equations of the second order 


Consider the differential equation 
moon au Ou Ou = 
NG Oat ° a cog to ae gu=r (4.2) 
and let boundary values # be prescribed for u(x, y) on a simple, closed, 
piecewise-smooth curve I" in the (x, y) plane (Fig. V/1). This is the 


BY oy 


+ Loundary pivot 
Fig. V/1. The boundary curve I’ and corresponding mesh boundary S 


so-called ‘‘first’”’ boundary-value problem, or the boundary-value problem 
of the first kind, for the differential equation (1.2) and the boundary J’. 
We assume that the given functions a, c,d, e, gz,” are continuous, and 
further that a,c are positive and g non-negative in a region B* of the 
(x, y) plane containing the boundary J’. he region actually bounded 
by I’ we denote by B and usually take this to be the closed region 
including the boundary J’. B* is as large an extension of B as is needed 
for the problem under consideration, and in some cases may be the 
improper extension B*=B (cf. § 2.4). 

We first introduce some useful terminology concerning the mesh 
points of the basic finite-difference mesh. Two mesh points will be re- 
ferred to as ‘‘neighbouring points” if they are consecutive mesh points 
on a mesh line. The term ‘“‘pivot’’ will be used for a mesh point which 
lies within or on J’. The pivots can be divided into “interior pivots”’ 
and “boundary pivots’: an interior pivot is a pivot for which all four 
neighbouring points are also pivots; a boundary pivot, on the other 
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hand, is a pivot for which at least one of its neighbouring points is not 
a pivot!. We assume that the interior pivots are “‘connected”’, i.e. given 
any two non-neighbouring interior pivots P and P*, we can find further 
InbenOr pIVGts PD, Pry. igP) (n21) such that consecutive members of 
the sequence P P P,... P, P* are neighbouring points. (An assumption 
of “simple connectivity” is not needed for our purposes.) The boundary 
curve J" may be associated with a ‘“‘mesh boundary’”’ S (Fig. V/1); this 
is a polygon with sides consisting only of sections of mesh lines and 
having the property that all mesh points which lie on them are either 
boundary pivots or isolated corners projecting beyond J, 


We now derive the equations for the approximate pivotal values 
U,,- For every interior pivot we write down a difference equation 


corresponding to (1.2): 


Uissr— 2U;, p+ U;_1 U; ti — 2U; 44+ 0; 4 4 
Qik 72 ee op z : =i 
U4, R= U;_ k U; kt+tu “t,k-1 
+ 4; ah +. a — 62 G n=, 2: 


If a square mesh (/ =/) is used, this can be written 
L;,(U] =h? 4,,, 
te(U] =15,[U] — (24; + 2¢;5 + 8,447) Uy, 
i¥,(U] = (4,.— 4s) Us-an+ (ain + 24s) Oia t (1.3) 


oi (cin = Ae, ») eee (cis +56.) U; 41: 


where 


With every boundary pivot A we associate a boundary point B (i.e. a 
point on J’) which lies on a mesh line through A such that the distance 
6 from A to B is less than the mesh width h (0<6<h). We assume that 
h is chosen so small that C, the neighbouring point to A furthest from B 
(Fig. V/1), is an interior pivot. Then for the pivot A we write down the 


equation 
U(A) eee ee (1.4) 
Oh 
} These definitions of ‘interior’? and ‘‘boundary”’ pivots are convenient for 
the theory, at least, as far as it is developed in the following. In a practical 
calculation, however, it is often desirable to use function values at mesh points 
lying near, though outside of, the boundary curve I” [for example, the heavily 
marked points in the subsidiary figure (a) of Fig. V/1] and it is then convenient 
to include these points as boundary pivots. As a consequence, some points which 
were originally boundary pivots, such as the point R in the figure, become interior 
pivots. 
2 Actually we do not need this “‘mesh boundary”’ for the theory presented here; 
for our purposes the classification of the pivots into boundary pivots and connected 


interior pivots is sufficient. 
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in which the modified notation has the obvious significance ; the equation 
implies that graphically the values #(B), U(A), U(C) are collinear. If A 
lies on I’, then B=A, 6=0 and U(A) is given its required boundary 
value #(A). 

Another approach for curved boundaries is to derive difference equations 
corresponding to (1.3) which make use of actual boundary points as pivotal points 
instead of only mesh points. For example, if a,h, a,h, agh, a,h are the distances 
from a mesh point P= (i,k) of four neighbouring pivotal poimts: Ai (ear ye); 
P= (i, A+), Py=(i—ag,h), Py=(i,k—a%), as in Fig. V/2, then 

2u(B) 2u (Py) 2u(B) 2u(PB) 
ay (4, + 4g) Ay (a2 + 4) a3 (43 + 43) aq (44+ a2) 


1 1 
oe ae 7 am U (Py) = AP (tty y+ tyy) (Fo) + O (A?) 


as can be verified by substituting the Taylor expansions centred on Fj for the 
values of u which appear. If the differential equation is of the form u,,+ tyy= 
gu—~y, this formula without the remainder term, and 
accordingly with u(F) replaced by the approximations 
U(F), provides a difference equation corresponding to 
the point P,. A similar application of TayLor’s theorem 
can also be used to derive corresponding difference 
equations for the more general differential equation 
(HE2) 


In many applications the boundary condition 
for the whole of the boundary J” or some part 


Fig. V/2. Unsymmetrical point : * : : es 
patton foie eRmEeRtdR ce of it ’* does not specify « but instead pre 


scribes the value of a linear combination of 
and its derivative 0u/dy in the direction of the inward normal 1, 1.e. we 
can have a condition of the form 


A, (s) «+ Ag(s) 3% = Ag(s) on I*, | (1.5) 


where s is the boundary parameter. When [*=I’, the problem of 
determining w is called the ‘“‘second’”’ boundary-value problem if A, (s) = 0 
and the ‘‘third’’ boundary-value problem if 4,(s)==0 (cf. Ch. I, § 3.3): 
when /* is properly a part of J’, we speak of a mixed boundary-value 
problem. One way of deriving a difference equation to simulate a 
boundary condition of the type (4.5) is the following?)?. 


1 See BATSCHELET, E.: Uber die numerische Auflésung von Randwertproblemen 
bei elliptischen partiellen Differentialgleichungen. Z. Angew. Math. Phys. 3, 
1465—193 (1952), where error estimates for the finite-difference method are also 
given; see also F. B. HILDEBRAND: Methods of applied mathematics, p. 307. New 
York 1952. — F.S SHaw: An introduction to relaxation methods, p. 120 et seq. 
New York 1953. 

2 More accurate formulae can be derived by bringing in more mesh points. 
A formula using 11 points is given by W. E. Mirne: Numerical solution of dif- 
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Consider a boundary pivot A of a sufficiently fine square mesh and 
let the local normal through A meet the boundary J’ in a point B which 
belongs to [* (Fig. V/3). The line BA 
produced will cut a mesh line at a first 


point C between two neighbouring mesh D d 
points D, E. Let the associated distances e 
be denoted as follows: oy 
c 
where a. 
£ 
1[e23)0, “20, c=0, 
catty =1. aahaton panepe 


Then for the boundary pivot A we can write down the difference 
equation 


A,(s) U(A) + Ap(s) 5 |e Fa) — 1(4)] = 4,6), (1.6) 


where s is to be given the value corresponding to the boundary point B. 


Iterative solution of the system of difference equations. When 
a fine mesh is used, the system of difference equations becomes rather 
large, and in consequence an iterative solution is frequently resorted to. 
Thus, starting from approximations U;®, we determine successive 


iterates U;2), U;?',... from the general formulae 


(24;,+ 2c;, + g;,h7) UF" =U] — hr,,, (1.7) 
w+ _ d6UM(C)+ha(B) ¢ (»=0,1, 2,...). 
U (A) rap (1.8) 
For LapLace’s equation 
2 Gu | Pu 
Uae ° 


the iteration formula (4.7) reduces to 


UF = 4 (OF at Oa + Oe + U1) 
= + x (Sum of the »-th iterates at the neighbouring points) ; 


(1.9) 


ferential equations, p. 150. New York and London 1953. — Further formulae are 
given by J. ALBRECHT and W. Unimann: Differenzenverfahren fiir die erste Rand- 
wertaufgabe mit krummlinigen Randern bei Au(x, y)=—yr(x, y,u). Z. Angew. 
Math. Mech. 37, 212-224 (1957). — UnHimann, W.: Differenzenverfahren fiir die 
4. Randwertaufgabe mit krummflachigen Randern bei Au(x, y, z)=9r(%, y, 2, u). 
Z. Angew. Math. Mech. 38, 130— 139 (1958). — Differenzenverfabren fiir die 2. und 
3. Randwertaufgabe mit krummlinigen Randern bei Au(%, y)=r(x%, y, u). Z. 
Angew. Math. Mech. 38, 236—251 (1958). 
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thus at each stage the value at the interior pivot (7, k) is to be replaced 
by the mean of the four neighbouring values (LIEBMANN’S averaging 
procedure?). 


Existence and uniqueness of the solution of the system of dif- 
ference equations. The system of equations (1.3), (1.4) for the U;, will 
always possess a uniquely determined solution if the mesh width h is 
chosen so small that a;,+-4hd;, and c;,+3he,, are positive for all pivots 
(i,k). This statement follows directly from Theorem 2 of Ch. I, §5.5, 
for we can easily verify that the conditions of that theorem are satisfied 
(the a;, in §5.5 do not have the same meaning as here). Firstly, the 
equations can be written down with the coefficients 24; , + 2¢;,—> h?g;, 01 1 
(corresponding to interior or boundary equations, respectively) on the lead- 
ing diagonal; then the diagonal coefficients are positive and the non-zero 
off-diagonal coefficients, which can only be —a;,+3hd;,, —C,+3%¢,, 


or are all negative. Secondly, all row sums of coefficients are 


ee: 
Oth’ 
non-negative and at least one row sum is positive: when they occur, 


equations of the form (1.4) give positive row sums since 1 — 55 >0; 


when no such equations occur, i.e. when all boundary pivots lie on the 
boundary curve I’, a positive row sum will arise from one of the equations 
(4.3) corresponding to an interior pivot with at least one of its neigh- 
bouring pivots, say P, on J’, for in such an equation «(P) is known 
and is therefore part of the inhomogeneous term, so that its coefficient 
is not to be included in the row sum. Thirdly, the non-decomposition 
of the matrix of coefficients follows from the assumption that the intenor 
pivots are connected. 

The weaker conditions of Theorem 3 of Ch. I, § 5.5 are therefore also 
satisfied, so that the convergence of the total-step and single-step 
iteration procedures? is assured at the same time. 


1.3. Principle of an error estimate for the finite-difference method 


An error estimate? for the class of problems considered in § 1.2 has 
been given by GERSCHGORIN*; existence of the solution w(x, 1) is 


* GERSCHGORIN, S.: Fehlerabschitzung fiir das Differenzenverfahren zur Losung 
partieller Differentialgleichungen. Z. Angew. Math. Mech. 10, 373—382 (1930). 

1 LiIEBMANN, H.: Die angenadherte Ermittlung harmonischer Funktionen und 
konformer Abbildung. S.-B. Bayer. Akad. Wiss., Math.-phys. Kl. 1918, 385—416.— 
Wo tr, F.: Uber die angendherte numerische Berechnung harmonischer und _ bi- 
harmonischer Funktionen. Z. Angew. Math. Mech. 6, 118—150 (1926). 

2 A different convergence proof based on subharmonic functions has been given 
by J.B. Diaz and R.C. Roserts: On the numerical solution of the Dirichlet 
problem for Laplace's difference equation. Quart. Appl. Math. 9, 355— 360 (1952). 

8 Error estimation can be looked at in another way, which is suggested by 
the inexactness of applied problems. This has been discussed by R. v. Mises: 
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assumed and also knowledge of upper bounds M,, for the maxima in B 
of the absolute values of the partial derivatives 0"u/@x" and ao" uly” 
up to #4: 

ou 


Ou 
Ox” Oy" 


sm, |% 


= M, in B for n =1,2,3,4. (1.10) 


It will often be difficult to establish strict upper bounds M,, and 
sometimes, for want of something better, one will use instead upper 
bounds for the corresponding difference quotients of the calculated 
approximations U;,. Since the partial derivatives may exceed these 
bounds, one clearly cannot claim that the error limits so obtained are 
rigorous; however, they should yield an indication of the size of the 
error, and sometimes one may be content with this}. 


The derivation of the error estimate follows the same general pattern 
as for ordinary differential equations (cf. Ch. IIT, § 3). We write down 
the difference expressions corresponding to (1.3) for the exact solution 
u(x, y) and expand them by means of Taytor’s theorem into differential 


On network methods in conformal mapping and in related problems. Nat. Bur. 
Stand., Appl. Math. Ser. 18, 1—7 (1952). He maintains that from a physical 
point of view it is more logical to look for an approximate solution U such that 


IZ(U]| <6, |%,(U}|<6 


for a given tolerance 6 (L{u] =0 being the given differential equation and ©, (uJ =0 
the associated boundary conditions) than to investigate the error e=U—u ina 
given approximate solution U. Thus the idea of convergence is replaced by the 
idea of simultaneous approximation of the differential equation and the boundary 
conditions. 

Application of this idea to the finite-difference method is a little troublesome ; 
having calculated approximate values at the mesh points, one still has to construct 
from them a function U for which L{U] can be formed. If, for example, we are 
treating a boundary-value problem with a second-order differential equation in 
two independent variables x, y by the finite-difference method and have obtained 
approximate values U;, for a function u(x, y) at the mesh points (¥;, y,), then the 
next step is to construct a set of polynomials, one for each cell of the mesh, which 
join together smoothly to form one continuous function U(x, vy) with continuous 
first and second derivatives with respect to each. independent variable. 

1 This difficulty in establishing or estimating the quantities M, which embar- 
rasses the application of the formulae (1.26) to (1.28) can sometimes be overcome 
by using special properties of the problem in question; for instance, GERSCHGORIN 
(loc. cit.) has shown that M, can be calculated exactly for the torsion problem 
for a rectangular bar. W. Wasow [J. Res. Nat. Bur. Stand. 48 (1952) Res. Paper 
2321] employs a different approach in his derivation of error estimates for the 
plane Laplace equation u, ,+ uyy= 0 in a rectangle. He considers the first boundary- 
value problem with u=/(s) on the boundary, where /(s) is a ‘‘reasonable’’ func- 
tion, and starts by reducing the problem to one in which f(s) =0 at the four 
corners of the rectangle; this can be done by subtracting out a suitable harmonic 
polynomial of the form a)+a,*+ a,y-+a,xy. Then « can be written as the sum 
of four functions u,; satisfying Veuj;=0 (7 4, 2, 3, 4) each of which also satisfies 
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expressions plus remainder terms. For instance, we have 


9 { Au WA ( Ouri—Tk Aur itt k 
a aS 2H. = (Fs), 7 ax ee 


in which we have used the notation 0” ujz7-,/¢x” to denote a value of 
é"uj@x" at a point on the section of mesh line between the mesh points 
(i,k) and (j,k). Similarly expanding the other difference expressions 
in (4.3), we obtain 


se dial = 45,4 ( et) a a ¥(= SEE MeL) 12 


Ox? |i Oxt ax4 
panne einer on (1.41) 
= = (L[“))a+ 42 R;,[u] = Vint ae ae ACIP 


in which the remainder term R;,[«] can be expressed in the form 


R;, [4] 
ht Auri—, Ouriti, 04 Ui,%k= Of U3, & REL 
= {aa( TIT | ih R—A 4) O86, RFI L (Yeas 


24 Ox* ox oy4* ay 
h Puzi—i,k Puritik Pui, kk-1 Pui,k, e+ \ 
a 12 {4;.( ox are 3x8 J+ en ey 4 cys Eh. 


Accordingly, since the approximations U;, satisfy (1.3), the errors 
En = Uj, (1.13) 
at interior pivots (7, k) satisfy the difference equations 


l,,[e] = —R,, [4]. (1.14) 


Assuming that the derivatives of « are bounded as in (1.10) we have 
1 he : : 
pe Riel] rs 5 (Ma (in + ¢;4) +2Mg(|dix| + le:al)} =)" Goesagie (TAB) 


the modified boundary condition on just one of the four sides of the rectangle 
and is zero on the other three. 

With a suitable choice of co-ordinate system u,, for example, may be expressed 
as a series of the form 


ty, = y an sin b,, x sinh c, y. 
FHI 

Now the finite-difference solution, which in itself is only defined at the mesh 
points, can also be represented by such a series, and this enables one to estimate 
the difference between the two solutions. If the mesh width is h, the upper bound 
for the absolute error finally arrived at is (4../f + 4,.\/$)A?, where 4,, 4, depend 
only on the size of the rectangle and 47}, Alf aré upper bounds for the absolute 
values of the second and third derivatives, respectively, of the given boundary 
values along the sides of the rectangle. All these quantities can be computed from 
the data. 
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Using Taytor’s theorem in a similar manner at the boundary pivots, 
we have (for a boundary pivot A and points B,C as in Fig. V/4 on a 
line parallel the x axis, for instance) 


u(C) =u (B) + 22) + 6) + SHB) + oe 


u(A) = (B) + 282) 5 4 Pub) 


where B, B are intermediate points. Elimination of du/dx yields 


“A u(B) +79, u(C) —Ry, (1.16) 
where 


R, = S+9)  u(B) 6 au(B) 
4 2 a are 


Comparison with (1.4) reveals that the error ¢ is given by 


é6 


Be h+o 


e(C) +R, (1.17) 


at the boundary pivots, and hence, using the fact that d<h, we have 
Je(4)| <4 ]e(C)] + 272M. (1.48) 


To estimate the error ¢ from (1.14), (4.15), (1.18), GERSCHGORIN 
introduces an auxiliary function W defined by 


L[W]=—1 inB, W=o on. 


Since we can hardly determine this function W in general, or even 
find limits for it, we will restrict ourselves for the remainder to a special 
case for which such an auxiliary function can be majorized and thereby 
a simple error estimate obtained. This special case is nevertheless still 
sufficiently general to cover many technically important problems. The 
additional assumption which we make is that we can find an ellipse E 
with axes parallel to the co-ordinate axes which has the following 
properties: no point of F lies inside of J’ and its semi-axes p and q are 
such that 
I4| 
p 


a c le| 

Pd =, lide. a) fed 
Omar: ea (1-19) 
everywhere in B. 


Let (x,, y,) be the centre of this ellipse and consider the auxiliary 
function 


2 (ey) =m + Blt ~ (=S22)— (222) w+ Bplay), (1.20) 
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in which yu and f are positive constants to be determined. Firstly B is 
chosen so that 


—4,[Z]2 RC, in B. (4.24) 
From (4.11), (4.12) we have 
sa in (Z) = — (LIZ]) a — Fae = — (L[Z])ix=“e +26 
a c aoe ¥ — Ve) el) Siete? (Yaa 
Xen ees |! ail | ne 


q 
Now for the ellipse - (1.49) holds and also 


|Ix—2|<p, |y—v| S49, 1— (25%) 22%) 20 in B; 


consequently 
~41,,[Z] 229 2hC, (4.22) 


in which the last inequality determines a lower bound for f. Thus we 


can choose 
p=+(4 (1.23) 


We now choose wu so that the result corresponding to (1.21) for 
boundary pivots also holds. In fact we verify that u=B +3h?M, isa 
suitable choice. For a typical boundary pivot A and its associated intenor 
pivot C, we have 


Z(A) —=252(C) =n gry +8(PA) — 45-5 PO) 


Sle aoe) rag PO] +3 M, =a 


Here, the last term is at least 3h? M, and, since OS 0S/h, OS G(A)S 

OS(C)S1, the factor rialtip ising B is non-negative (in fact it < 
between 0 and 2); thus the right-hand side cannot be less than the 
upper bound $/2M, of (1.17) for |R4| and we have 
0) | 0) 


3 
pep ele), S 3 MM SZd) — 4) 


‘ac te B* 


E( A= Zc). (1.24) 


This corresponds to 
—jrfale]| S— js al] 


for interior pivots, which follows from (4.14), (1.15), (4.22). 

The matrix of the system of these inequalities written down for 
every pivot satisfies the conditions of Theorem 2 of Ch. I, §5.5, as we 
have already seen in §1.2; we can therefore use the monotonic property 
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which is assured by that theorem to obtain the error estimate 
|e(A)| SZ(A) and le;,|S2Z;, in B, (1.25) 


or, using the maximum value of Z from (1.20), 


* [U..— «5, = er B, (1.26) 
ere 
ee M, (a+) + 2M,(|d| + Je|) 
p= (rete rian (1.27) 
ts p 7 p q max in B 
Ti 
H=B+3hM,. (1.28) 


When all boundary pivots actually lie on the boundary curve J’, no 
equations of the type (1.4) are needed and the estimate (1926), (1.27) 
is valid with « =0. 

The special case with the differential equation 


a(x,9) a telx,9) £5 =r(x,9) (1.29) 


includes many important problems. Since d==e =O for this case, the 
expression (1.27) for 8 simplifies considerably to 


_ 22 “yo? 
B= 28 (1.30) 


if we choose  =q =@ as the radius of a circle enclosing B. 


1.4. An error estimate for the iterative solution of the difference 
equations 

For the class of problems considered in § 1.2 a very simple error 
estimate for the iteration procedure described there can be derived by 
using again the monotonic property assured by Theorem 2 of Ch. I, §5.5. 
In § 1.2 it has already been established that the matrix of coefficients 
associated with the system of equations (1.3), (1.4) satisfies the conditions 
of that theorem. The practical application of the consequent possibility 
of bracketing the solution of the difference equations is described by 
means of an example in § 1.6, where it is used for error estimation in 
connection with the relaxation method. We use it here in a different 
way to derive an error estimate of more general type. 

Suppose that we have continued the iteration process until the 
numbers have settled to the accuracy of the number of decimals carried, 
say m. We then have approximations U,? for which no further iterations 
improve the last decimal. This, however, is no guarantee that the last 


Collatz, Numerical treatment, 3rd edit., 2nd print. 23 
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decimal is correct; in fact, as is well illustrated by an example given 
by Wo tF}, it can still differ considerably from the corresponding figure 
in the exact solution U,, of the system of equations (1.3), (1.4). Con- 
sequently one is interested in having an indication of how great this 


departure ¢!} = Uj#!— U,,, can be for known changes oy; = Ug7"— Uy. 
From coe ae (1.7) it follows that 
bi h? [UM] =}. | _ 77 
Oth Qagy t 26m Bin | he rin] — Ob 
= hi? FL 
Daze t 2jp+ Binh? | he ral 21) 
= h® ee 
24;4+ 264+ bin)? | Be E 
similarly from (4.4) and (1.8) we have 
oo” (A) = Ue (A) — u™ a ane U™ (C) all 
h- 7 6 
A+ a are, ; 


Thus the errors €},¢™(A) satisfy a system of equations with the same 
matrix of pte as the system (1.14), (4.17) but with different right- 


hand sides. The — —, we Rial] and — R,, which are a by 47°C, 

alge = 
ak _ Sieh? ol” 
and o”(A), respectively. Since all the changes of}, 0 (4) are known, 
we can find bounds for the new right-hand sides, and we have precisely 
the same situation as in § 1.3. Consequently the error estimate given 
there [(4.26) to (1.28)] can be carried over immediately with the sub- 
stitutions just mentioned: 


and +3? M,, oe are replaced here by ? 


‘ [cya] = |G — U;,| Se* + B*, (4.33) 
where 
~ 1 2 
; ~? q? Pry; > q ‘maxinB 
an 
pe = p* + 2|o"!(A) | max: (1.35) 
In particular, for the differential equation (1.29) we can use 
pe (1.36) 


where @ has the same significance as in (1.30). 


1 See pp. 130—131 of the paper by F. Wo tr already cited in § 1.2 [Z. Angew. 
Math. Mech. 6, 118—150 (1926)]. 
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If this iterative calculation is carried out with m decimals, then for 
the stage at which the numbers settle we can put [o™ | ace x10-". 
If, for instance, o=4, h=0-1 and m=4, B* can be as large as 0-08 
and we cannot even be sure of the first decimal. This situation worsens 
as h decreases, and often it is not allowed for sufficiently. 


1.5. Examples of the application of the ordinary finite-difference 
method 


I. A problem in plane potential flow. We consider the flow of an incom- 
pressible ‘“‘ideal’’ fluid through a two-dimensional channel in which there is a 
tight-angle bend. Let 4BC and DEF be the walls of the channel as in Fig. V/4. 
We are to calculate the velocity distribu- 
tion and streamlines within the region 
ABCDEF assuming that the fluid flows 
in with unit velocity across the entrance 
AF and out with unit velocity across the exit 
CD. The velocity components v, and vy can 
be written as the partial derivatives of a 
stream-function WY or of a potential @: 


If we work in terms of ®, we have the 
“second boundary-value problem’ of poten- Fig. V/4. Flow through a bent channel 
tial theory, for the normal derivative 0@/ér, 

representing the normal component of the velocity (vy directed inwards), is 
prescribed on the whole of the boundary. Thus we have V?®=0 within the 


region ABCDEF and 
0 along ABC and DEF, 


= = 1 along AF, 
—MedlonraG 2, 


The second boundary-value problem of potential theory may be 
reduced to the first by the introduction of the conjugate potential 
function, which in this case coincides with the stream-function Ye 
say). (The present problem can also be formulated directly in terms of 
the stream-function.) 

The required streamlines are therefore the lines « — constant, where 
“ is the harmonic function determined by the boundary values 


0 along ABC, 
“= 1 along’ DEF, 
linearly increasing along AF and CD. 


(a) First of all a rough idea of the distribution of u values is obtained 


by using a coarse mesh with A=. If we make use of the symmetry 


23* 
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about BE, the number of unknowns reduces to nine; we denote them 
by a, 6,..., 7 at the points indicated in Fig. V/5. We use the difference 
equation (1.3) to express ¢, d, e, f,...,1 successively in terms of a and b: 


0 0 00 0 0 0 c=4a—6—i, 


meme ne 

ce pel: tbs OE 

Pere el | 
7 


e|_|o then the difference equations for the two 
7 | o pivots on the line of symmetry yield a pair 
of simultaneous equations for a and 5 with 


0 
3 % the solution 
Fig. V/5. The boundary-value pro- 
blem for the conjugate potential 5021 10177 
function => b= 


~~ 45525 15525’ 


which, substituted back, gives the approximate values 


(0) 10) 0 0) 0 0 

0:33333 0°32341 0:30480 0:26377 0:18254  0:09127 
0:66667 0°65552  0°63201  0:56773 0:37514  0°18254 
1 1 1 4 0°56773 0°26377 


Conmce) 


(b) We next illustrate LiEBMANN’s iteration method on the equations 
obtained using a slightly finer mesh with h =}. The iteration is started 
with the following values, which were obtained by graphical interpolation 
from the values calculated in (a) with h=4#: 


0 0 10) 10) 0 0 0 0 
0°25 0°25 0:24 0°22 0:19 0-15 0-10 0:05 
0:50 0:50 0:49 0:46 0°39 0°30 0-20 

0°75 0°75 0:74 0°71 0:65 0°48 

1 il 1 1 1 


ooooc°o 


We calculate new values at each interior pivot from the four neigh- 
bouring values by the averaging procedure of (1.9). The results are set 
out below; beneath each new value we record in brackets the change 
from the old value (in fourth-decimal units), which may be regarded as 
a correction. 


0 0 0 0 ra) 0 0 0 0 

0:25 0:2475 0:24 0°2225 0:19 0:1475 O40 0-05 O 
(—25) = (0) (+25) (0) (—25) (0) (0) 

0°50 0:4975 0:4850 0:4525 0:40 0:3050 0:20 ry) 
(—25) (—50) (—75) (+100) (+ 50) (0) 

0-75 0:7475 0:7375 0°7125 0:6450 0-4750 0 


(—25) (—25) (425) (—50) (—50) 
4 1 1 1 1 10) 
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By applying the same averaging procedure to these changes we 
obtain the changes for the next cycle, which in turn yield the changes 
for the following cycle (in brackets) : 


0 0) 


) ty) ) 0 ty) 0 0) 

0 — 6(—10) —13(+144) —19(+ 9) +25(— 6) +13(+ 6) — 6(+10) 0(—3) 0 
OWeteeae) 31 \— 6) 35(—27) —19(4+-19) + 6(+ 5) +25(0) ) 
; =i 9) ee —38(+ 8) +19(—14) — 0(+-13) ) 
) 0 ft) 


One can continue averaging the changes, then calculate “‘best’’ values 
by extrapolation and repeat the whole process again with these as 
starting values. In general the convergence of the process is slow and 
many suggestions for improving it have been madel. These do not 
always have the desired effect; for example, an extrapolation based on 
a geometric series can, in fact, make matters worse. (A different type 
of correction calculation using relaxation is described in § 1.6.) In our 
example here a number of further iterations yields the following results, 
for which the next iteration would produce a maximum change of 
0-00003: 


0 0 0) 0 0 0 0) 0 

0-25 0:24404 0:23517 0:21948 0°19217 0°15028 0:10135 0-05068 
0°50 0:49110 047716 0-45064 0°39898 0-30756 0-20447 

0°75 0°74323 0-73185 0:70701 0°64564 0°47660 

1 1 1 1 1 


SOTOororS 


One normally increases the accuracy by using a smaller mesh width, 
but here the accuracy can also be increased by subtracting out the 
singularity?. This can be a useful expedient in many other situations 
in which singularities appear. 


II. An equation of more general type (1.2). If a single turn of a helical 
spring of small angle w and radius R is deformed into a plane ring under the 
influence of an axial load, the stress-function @ can be shown to satisfy the dif- 


1 WELLER, R., G. H. SHoRTLEY and B. FRIED: J. Appl. Phys., Lancaster Pa. 
9, 334—344 (1939); 11, 283—290 (1940). 

? This device is used by S. GERSCHGORIN: Z. Angew. Math. Mech. 10, 373— 382 
(1930); see also W. E. MiLNE: Numerical solution of differential equations, p. 221. 
New York and London 1953. — Woops, L.C.: The relaxation treatment of 
singular points in Poissons equation. Quart. J. Mech. Appl. Math. 6, 163—185 
(1953), deals with three types of singularities: 1. A logarithmic singularity in u 
at a point P, which can be subtracted out, 2. A discontinuity in wat P; for instance, 
there may be a jump in the given boundary values at a point / on the boundary 
[for plane potential problems one can subtract out the function ag, where (r, ¢) 
are polar co-ordinates centred at P and a is suitably chosen]. 3. The derivatives 
of uw are unbounded at P although u is continuous there (this is the case in the above 
example). With suitable «,8,m one can subtract the function (asin me $+ 
Bcos mq) r™. 
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ferential equation 
aD eo 3 o®@ 
—2GA=0 
aa + Ott R—y Oy 
and the boundary condition 
Oo ion, 
where J’ is the boundary of the cross-section in the (x, y) plane (containing the 


axis of the spring) (Fig. V/6). G is the modulus of rigidity and ye see et 


The shear-stress components are given by 


( R 3 
Ce 


| 
| 
| 
| 


TEI A ae 
me ( R ao 
an aes 


We consider the special case with the 
Fig. V/6. Cross-section of a coil of a helical . es 
spring rectangular cross-section 


|xjS4, |y|St 
and R=5. Then, in terms of a new dependent variable u defined by 
@= — 2Gihu, 
the problem reads 
Uy yt Uyy + = st 4=0, u=Oon©l. 


(a) For a coarse mesh with h= 4% there are only the three unknown # values 
a,b,c at the points indicated in Fig. V/7. They satisfy the difference equations 


b 
4(b— 4a) + a> +1=0, 
3 c—a 
er t= AU +1=0, 
3 o—6 
4(b—4 — a hg 
( a aa 
with the solution 
1379 
7 
9° 
b=-— —— = 0°106 57, 
929 os 
Fig. V/7. Notation for pivotal values 1259 
c=: —— = 0:08470. 
16 Xx 929 


(b) For a mesh with h = } we have, on account of symmetry, just five unknown 
values a,b,c, d,e as in Fig. V/7. If we express four of these unknowns in terms 
of the other, say e, by means of the difference equations, then the last equation 
determines e: 


d= 3°391304e —4X 1:130435, 
c = 10°154783e —$X 4918261, 
b = 29-70435 e — 4 x 16°12367, 
a = 86:07586 e — } X 48°54253, 


7680-677 — 4 X 4388-762 = 0. 


1 BrezEno, C. B., and R.GRAMMEL: Technische Dynamik, 2nd ed., Vol. I, 
asides Lose 


! | A 

—-2|-—06 | o |o lo lo 0 ) ) 0 ) 
—1 | —0-25' 0 |0:05244 '0-07447 '0:08289 |0-08420 |0-08010 |0:06912 |0-04622 | 0 

) 0) O |0:06794 0:09798 0:10968 |0:11151 |0:10576 |0:09050 |0-059 36 
_ a . | aan ——— | —_ a 

1 
E — 0-016 304 0:017046 0:017857 0-018750'0-019736 0:020833!0-022059 
3 ont 
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Therefore 
a@ = 0-071 28, 
b = 0-094 39, 
€ = 0:09825, 
d = 0:08971, 


€ = 0:063 4892, 
8c = 0-11053. 


The last value $c corresponds to the centre of the rectangle. 


(c) For the finer mesh with 4 = + the difference equations are best solved by 
iteration. With mesh points (x;, yg) = (ih, Rh) the equations can be put in the form 


ae oa 1 
U2= q Uitaat Uae t Uinta t Uj ny) + oo ae (Ui+1,8—Ui—-a,n) + ane 


As in Example I, we estimate starting values for the U;, from graphs of the results 
of the calculation with h=4. For convenience we iterate only on the changes. 


The results are exhibited in Table V/41, whose last row gives the factors = aot j 
25 >y% 


which can be calculated once and for all. 


III. A differential equation of the fourth order. Ifa non-uniformly 
loaded square plate of side 2A has two opposite sides firmly clamped 
and the other two smoothly hinged (Fig. V/8), the deflection wu will 


satisfy : 
iu — p =(4) Po 
N A [Nee 
— =0 for |#|=A, 


u=V*u=0 for |y| =A. 


Let #) and N be constants. 

Using the symmetry of the problem, we can reduce the number of 
unknown values for the mesh width h ~ 3A to four, namely the a, b,c, d 
as shown in the figure. In setting up the difference equations, we find 
that values outside of the square are needed. As indicated in the figure, 
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these can be expressed in terms of the values inside by means of the 
boundary conditions; for example, the values —c, —d follow from the 
difference equations representing the 
boundary condition V?u=0. Let us 


put is Po __ q 


then, using Table VI of the appendix, 
we can immediately write down the set 
of difference equations: 


20a —16b —16c + 8d =O, 
206 — 8a—16d+ 4c +2) =2k, 
20c — 8a—16d-+ 4b == (0). 


20d — 8b— 8c+2a+2d=2k. 


The solution is 


310 
=—-__ k = 0-0048 
a or 043874, 


jee = 6 
oo 0-00405 q, 


227 
497 


c= k = 0-003 574q, 


d —1% k = 0.00304. 
497 
If we choose h= 3A, we obtain some- 
what more accurate results with still only 
four unknowns (see Fig. V/8). Thus from 
the difference equations 


6a— 5B— Sy+ 26=—s, 
—S5a+13B + 2y— 76=9s, 
—Sa+ 28+ 11y— 76=s, 
2n— 78 — 7y¥ + 206=9s, 


Fig. V/8. Notation for pivotal values 


4 
where s = A bg _ 16 q, we obtain the values 
25 N 15625 
6755 ee ag 
4383 R186. os 
¥ epg mere é6= 1522 s = 0002144. 


1.6. Relaxation with error estimation 
The practical application of the ordinary finite-difference method 
in conjunction with the relaxation procedure? will be explained by means 


1 See, for example, G. SHORTLEY, R. WELLER, P. DarsBy and E. H. GAMBLE: 
Numerical solution of axisymmetrical problems, with applications to electrostatics 
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of an example. We consider the problem of determining the steady 
temperature distribution u (x, y) in a homogeneous square plate of side 
A whose edges are kept at the constant temperatures wu =0 and u—1 
as specified in Fig. V/9; u satisfies the potential un 


equation V?4—0. 
As usual we begin with a coarse mesh so as 
to get a rough idea of the solution from which 
we can estimate starting values for the next step. = vn) 
With h=1A we have two unknown values a,b * 


(see Fig. V/9) ; they satisfy the difference equations ale 
4a—@+0+4, 46=44-5644+41, 

from which we obtain a =8,6=2. These values, 
rounded to 0-63 and 0-88, are taken over for 
the first approximation on the finer mesh with 
h=@A. Thus we have first approximations to 
the values g,7 in Fig. V/9; we estimate the re- 
maining values by graphical interpolation, deal- 
ing with /, 7, first. These starting values are 
recorded in the upper-left quadrants at the inter- 
sections in Table V/2, Stage (i); each intersection _ 
corresponds to a pivot. The numbers in the speie ya seein ects 
upper-right quadrants are the arithmetic means on 

of the values in the four neighbouring upper-left quadrants, i.e. the next 
approximation in the iteration of § 1.2; for the point a, for instance, 


ee 0-25 x (0-39 + 0 + 0:39 + 0-59) = 0-3425. 


In the lower-right quadrants we enter the changes thus produced, ex- 
pressing them in fourth-decimal units (for example, at a we have 
0-3425 —0-32= 225 x10-4). 

Now if the difference equation for a particular pivot is satisfied by 
the starting values, the corresponding change must be zero!; con- 


and torsion. J. Appl. Phys. 18, 116—129 (1947). A detailed description, which 
also describes many little artifices, is given by L. Fox: Some improvements in the 
use of relaxation methods for the solution of ordinary and partial differential 
equations. Proc. Roy. Soc. Lond., Ser. A 190, 31—59 (1947). Comprehensive 
treatments are to be found in the books by SOUTHWELL which were cited earlier 
and also in F.S. SHaw: An introduction to relaxation methods. New York: 
Dover Publ., Inc. 1953, 396 pp. A theory is developed by G. TEMPLE: The general 
theory of relaxation methods applied to linear systems. Proc. Roy. Soc. Lond., 
Ser. A 169, 476—500 (1939). 

1 Translator’s note: These changes produced in the starting values by one step 
of the iteration procedure are, in fact, identical with (or at least proportional to) 
what would in the customary relaxational parlance be called the ‘‘residuals’’ 
corresponding to the starting values; see Ch. III, § 1.4. 
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sequently we relax the starting values, i.e. make corrections to them, 
so as to make the changes as small as possible. If at the pivot a, for 
example, we had taken the value 0-34 instead of 0-32, a correction of 
+ 2001074, the change at a would have been only 25 instead of 225 
(in 10-4 units), but the changes at the four neighbouring pivots would 
have been greater by +50. The procedure is most conveniently carried 
out in two relaxation tables, one for the corrections and the other for 
the changes, as in Table V/3. The numbers which are framed in the 
arrays of changes are the changes current at the start of each table, 
the other numbers being the alterations produced by the corrections. 

For the relaxation of the starting values we note that the correction 
of + 200 at a alters the changes by the amounts underlined in the table, 
i.e. —200 at a and +50 at d and ¢. Similarly we make corrections at 
all pivots where particularly large changes appear, recording these 
corrections and the corresponding amounts by which they alter the 
changes in the appropriate columns. In doing this we must remember 
that on account of symmetry we are correcting two values at once, 
except on the line of symmetry, so that any change which is affected 
by both must be altered accordingly; thus the correction of —120 at / 
alters the changes at g and / by —30, but the change at a by — 60. 

It is convenient to review the situation now by calculating the net 
effect on the changes so far and start again in a fresh table with these 
new changes as starting changes; these are framed in the table and it 
can be seen that their maximum absolute value is now 35 instead of 
225. We continue the relaxation from these improved values as in the 
table, making corrections which eventually bring the maximum absolute 
value of the changes down to 3 x1074; at this stage we must increase 
the number of decimals in order to be able to make further improvements. 
The current values of u are easily calculated by adding the corrections 
to the starting values; for example, for a we have 

0-32 + 0-0200 — 0-0084 = 0:3316. 

As a check we carry out the averaging process of the Liebmann iteration 
on these improved w values and thus make an independent calculation 
of the new changes [Table V/2, Stage (ii)]|._ The corresponding results 
after repeating the procedure with an extra decimal are given in 
Table V/2, Stage (iii)?. 

1 An “over-relaxation”’ in which, for the solution of the system of linear 
equations tt 

DR th = % (= Uh aean By 
RL 
one determines a sequence of approximations Ed generally by 
aoe = xiv —o oo A; , AUTH + Zain air] — ni} 


is investigated by D. M. Younc: Iterative methods for solving partial difference 
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A point of computational technique may be mentioned here. It is 
a fact that the magnitudes of the changes can be reduced easily in a 
region where the changes alternate in sign, but not in a region where 
they have the same sign. A useful technique for dealing with this latter 
situation is provided by the so-called “block relaxation’’, in which one 
makes identical corrections at a block of points!. The general effect 
achieved by this is typified by the following example, in which correc- 
tions of 4a are made at points in a rectangular block: 


Corrections Effect on the changes 
a a a vd a 
4a 4a 4a 4a 4a a —20 —o —a —a —2a0 «a 
4a 4a 4a 4a 4a a a O 9) 0 —o a“ 
4a 4a 4a 4a 4a a —2a —oO —a —a —2a% «a 
rod (vd (od a a 


With this characteristic pattern in mind it is easy to determine for 
any particular case which points to include in the block and what value 
to take for the correction 4a. An example occurs in Table V/3, (2), in 
which the changes at the pivots a, 0, f, g, 1, m are all negative; the block 
correction of —60 produces the underlined alterations in the table of 
changes. 

A comparison of Stages (ii) and (iii) of Table V/2 reveals that in the 
values of « the third decimal has altered even though the changes in 
Stage (ii) are confined to the fourth decimal. The possibility of this 
“qll-conditioning’”’ has already been mentioned in § 1.4; it can become 
dangerously bad, particularly when a large number of pivots are used. 


Error estimation with relaxation. From § 1.4 and Theorem 2 of 
Ch. I, §5.5 we have the following bracketing rule for the solutions of 
the difference equations of § 1.2: 


equations of elliptic type. Trans. Amer. Math. Soc. 76, 92—111 (1954). — On 
the Solution of Linear Systems by Iteration. Proc. Symp. Appl. Math. 6, 283—298 
(1956). He gives a rule for the suitable choice of the “‘relaxation factor’’ w. Pre- 
viously L. F. RicHarpson: Phil. Trans. Roy. Soc. Lond., Ser. A 210, 307—357 
(1911), had used a relaxation factor which even varied from step to step. — See 
also L. F. RicHarpson: Phil. Trans. Roy. Soc. Lond., Ser. A 242, 439—491 
(1950). Over-relaxation is also considered by D. N. pe G. ALLEN: La méthode de 
libération des liaisons .... Colloques Internat. Centre Nat. Rech. Sci. 14 (Méthodes 
de calcul dans les problémes de méchaniques) 11—34. Marseilles and Paris 1949. 

1 For a description of block relaxation see R. V. SOUTHWELL: Relaxation 
methods in theoretical physics, p.§5. Oxford 1946. Numerous applications of block 
relaxation are to be found in the literature; see, for example, D. C. GitLtEs: The 
use of interlacing nets for the application of relaxation methods to problems 
involving two dependent variables, with a foreword by W. G. BicKLEy. Proc. 
Roy. Soc. Lond., Ser. A 193, 407—433 (1948). — DUSINBERRE, G. M.: Numerical 
analysis of heat flow, 227 pp. New York-Toronto-London 1949; on p. 65 of this 
book a large number of point patterns for block relaxation are reproduced. 
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I} we have a set of approximate values for the solution of the difference 
equations of § 1.2 for which the changes are everywhere non-positive (or 
everywhere non-negative), then each of these values is greater than or equal 
to (or, respectively, less than or equal to) the corresponding exact value 
of the solution of the difference equations. (Whether they are greater or 
less than the corresponding values of the exact solution of the boundary- 
value problem is another matter). 


A set of changes with no variations in sign can usually be achieved 
quite quickly with block relaxation. Table V/4 shows the relaxations 
required to bring about all non-positive and all non-negative changes, 
respectively, for the approximations obtained in our present example 
at Stage (iii) (Table V/2, upper-left quadrants) ; all numbers are expressed 
in fifth-decimal units. In the first half A. the effect of the corrections 
is given in detail: the framed numbers are the starting changes taken 
from Table V/2, Stage (iii); the underlined numbers are the alterations 
produced by the block of five corrections of --4 in the third column ; 
combination of all the alterations yields the non-positive new changes. 
The corresponding approximate solution, which is everywhere greater 
than or equal to the exact solution of the difference equations, is 
exhibited in Table V/5 (same arrangement as in Table V/2). The second 
half B. of Table V/4 gives the corrections necessary to produce all non- 
negative changes; the corresponding approximate values, which are 
consequently lower limits, are exhibited in Table V/6. Thus for the 
value b, for example, we have the limits 


0-58064 < b= 0-58088. 


In actual fact, although we have not proved it here, the numbers in 
the upper-right quadrants of Tables V/5 and V/6, i.e. the next Liebmann 
iterates, also provide upper and lower limits, respectively, so that the 
more accurate result 

0-58066 < b= 0-58085 
also holds? 

A generalized form of block relaxation? which is usually more 
effective than the ordinary form for large blocks is obtained by choosing 
the values of the corrections so that they represent a discrete sub- 
harmonic function in the sense that the value at cach point of the block 
is greater than or equal] to the arithmetic mean of the values at the 
four neighbouring points, the values outside of the block being zero. 


1 For proof see L. Cottatz: EinschlieBungssatze bei Iteration und Relaxation. 
Z. Angew. Math. Mech. 32, 76—84 (1952). 

* The ‘“‘Scheibenrelaxation”’ of E. StieFEL: Uber einige Methoden der Relaxa- 
tionsrechnung. Z. Angew. Math. Phys. 3, 1—33 (1952). 
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Table V/4. Relaxation of an approximate solution to obtain changes with no variations 
in sign 


A. Non-positive changes (for an upper bound) 


B. Non-negative changes 


Corrections 


Alterations produced 


New changes Corrections New changes 


Table V/5. Upper bounds for the solution of the difference equations 


0 0 10) 

033064 0°33064 0:370 84 0°37083 0°53136 | 0:53135 1 
0 | —14 | —4 

0-58088 058085 0°62132 | 0-62134  0:75456 | 0:75454 | 

* E _— a meng — a 

0°75012 0-75012  0:77896 | 077895 0°86548 | 0-86545 1 
0 —1 | —3 

0-861 68 0:86165 0:878 88 0:87888 0:92828 | 0°92827 1 
=3) 0 — i 

0°93872 0°938 72 0-945 60 0:945 58 0:96872 | 0:96872 4 
0 —2 | 0 

1 1 Ae] 
Table V/6. Lower bounds for the solution of the difference equations 

0 0 0 

0°330 52 0°330 52 0°37072 0°37073 0:53128 | 0:°53128 i 
0 sel 0 = 

0:58064 0:58066 0:621 12 062112 0:75440 | 0°75443 | 
—— _ ——__———— — -|- — ——. — —_—— \— —----—_— —_—— 
+2 ce) ape 

0°74988 0°749 88 0:77872 0°77875 086532 | 0°86532 { 
0 | +3 0 

0°861 44 0:861 46 0:87868 0:87870 0:928 16 0-928 16 1 
42 a Oe) 

0:93860 0-938 60 0:94648 | 0:94648 0:968 64 0-968 66 1 
0 0 42° _ 


1 


1 


Age —— 4 Ome ad (9) 
—24 —20 —12|+2 Oo +3 
—24 —24 —12 0 +3 0 
—20 —20 — 8|4+2 +2 0 
-—8—8— #0" 0 4a 
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This leaves considerable freedom of choice, and a variety of such group 
relaxations can easily be constructed ; the following is a typical example: 


Corrections Effect on the changes 
a 20 2a a 
4a 8a 8a 4a tod ie) —20 —2a 8) (v4 
8a 12% 12a 8a 2a —2a — 2a — 2a —2a 20 
8a 120 12a 8« 2a — 2a — 2a — 2a —2a 2a 
4a 8a 8a 4a a (6) —20 —2a (0) v4 
a 2n 2a (od 


We conclude this section on relaxation by mentioning a phenomenon 
which manifests itself in systematic relaxation procedures such as the 
modification of the Liebmann iteration (4.9) in which one deals with 
the pivots in a fixed cycle and always uses the latest improved values at 
the neighbouring pivots. To simplify the description we confine ourselves 
to two equations in two unknowns: 


Ay1% + Aye%y=7, 


Ag % + AgoXy = 7p. 


(egy), 


Consider the iteration pro- 
cedure defined by 


1 
ama =, a,» xf) , 
4x) 
al 
2 lin =— (1, — ay, att) 
a9 
a= 04, 2).3;) 


(the single-step iteration 


Fig. V/10. A drawback of systematic relaxation procedures due 
method of Ch. Sa 5) to the occurence of ‘‘cages”” 


and assume that it con- 


verges. The procedure admits of a simple geometrical representation 
if the two lines defined by (1.37) are drawn in the (x,, x) plane, as 
in Fig. V/10. The zigzag line connects the sequence of points (ek?! wal), 
Cr a), (al Ycal" 1), |. amdeweesee immediately that for k 
greater than a certain value ky (here ky==0) the points (x{*), x!) all 
remain in a fixed “‘wedge’’, which STIEFEL (see last footnote) calls a 
“Kafig’’, ie. a ‘cage’. When the angle of the wedge is small, the 
convergence of the sequence of points to the solution, i.e. to the point 
of intersection, is slow. Similar “‘cages’’ occur also with larger systems 
of equations; they cause the situation in which substantial improve- 
ments are obtained from the first stage of a systematic relaxation 
procedure (getting into the cage) but only moderate improvements from 
subsequent stages. 
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1.7. Three independent variables (spatial problems) 


For most problems with more than two independent variables solu- 
tion by finite differences is very tedious, for as soon as one starts to 
refine the mesh the number of unknown pivotal values increases very 
rapidly. Nevertheless one can easily think of examples for which the 
finite-difference method is the only really feasible numerical method. 
It may be remarked that the extension to more than two independent 
variables introduces no new fundamental difficulties. 

We choose for illustration an example possessing a high degree of 
symmetry; this permits a considerable reduction in the number of 
unknowns. Suppose that a homogeneous material occupies the cube 
|x|<1, |y|S1, |z|S1 and that two opposite vertices are maintained at 
the temperatures +1 and —1, respectively, while the rest of the surface 
is insulated. Then the steady temperature distribution satisfies the 
boundary-value problem 


V2u=0 inside the cube, 
oa =! for |x|=1, |y|=4, |z|=1, 
w#=41 for *x=y=z=1 and w=—1 for *=y=z2z=—1. 


For a three-dimensional square mesh with mesh width h = 3 we have 
the nine unknown pivotal values a, b, ..., k as shown in Fig. V/11. The 
boundary condition @u/dy =0 is satisfied by introducing symmetrical 
function values at neighbouring points outside of the cube, as shown 
in Fig. V/41 for a few typical points. It is expedient in setting up the 
difference equations corresponding to V?#=0 (formula in Table V1 of 
the appendix) to make a sketch as in Fig. V/11. We obtain the equations 


—6a+6+4¢d€4+1=0, 
a—6b+c+4e=0, 
b—3c+2f=0, 
a—3d+e+i1=0, 
b+d—6e+/+e¢+2k=0, 
c+2e—7/—2g=0, 
=| — I=, 

b= Qi aes 
2e—gti-—8k=0, 


which yield 
a= er = 02656, b= es =0-0807, ¢= it = 0-0387, 
d= a = 01282, ¢ = = 00450, f= 7 =00177, 


1.7. Three independent variables (spatial problems) 369 


In some cases it is possible to transform the spatial problem into a plane 
problem. For example, TRANTER! reduces the first boundary-value problem for 
the equation 

V2 + f(x,9,2) =0 (1.38) 


in a cylinder, i.e. with the boundary conditions 


“u=h,(%,y) for z=0 
u=h,(%,y) for z= 
u = g(%,y,z) on the curved surface of a cylinder parallel to the z axis, 


to a set of first boundary-value pro- 
blems in the region of the (x, y) plane 
representing the cross-section of the 
cylinder by means of finite Fourier g 
transforms 


ie g a 


7 
u(n) = u(n, x, y) = fusinnzdz 
o 
(31,25 Sh ocala 


If (1.38) is multiplied by sin nz and 
integrated with respect to z from 0 
to z, integration by parts yields a 
two-dimensional partial differential 
equation for v(m): 


| 
| 


. 
i 


| 
| 


Ke, 
t 


OE AME 


Tate [Ay — (—78 hg] ate (4.39) Fig. V/11, The finite-difference method for a three- 
dimensional temperature distribution 


bia 
+ ffsinnzdz=0. 
0 
On the boundary of the cross-section v(m) must take the value 
= 
fgsinnzdsz. 
0 


This boundary-value problem is solved approximately for several values of » by 
the finite-difference method and relaxation, then u is determined by Fourier 
synthesis. 

TRANTER also considers the mixed boundary-value problem with the normal 
derivative prescribed on the plane ends of the cylinder; for this he uses the cosine 


transform oo 
v(n) = fucosnzdz. 
i 


The appropriate transforms for the corresponding problems with a semi-infinite 
cylinder are ‘ 
= fulrlerds 
A 9 \cos ; 


This technique of reducing the number of independent variables by means of 
integral transforms (Fourier, Laplace and allied transforms all have their particular 
applications) can be used in a variety of problems. 


1 TRANTER, C. J.: The combined use of relaxation methods and Fourier trans- 
forms in the solution of some three-dimensional boundary value problems. Quart. 


J. Mech. Appl. Math. 1, 281 —286 (1948); a numerical example is given. 
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1.8. Arbitrary mesh systems 


A formula which approximates a dificrential equation to a certain order of 
accuracy by a relation between pivotal values (i.e. function values at mesh points) 
generally requires more of these pivotcl values when the mesh is chosen to be other 
than rectangular! (here we are again restricting ourselves to the plane). For 
example, in the case of the second-order differential equation 


L[u] = A Uyy + 2Buyy + Cttyy+ 2Du,+ 2Eu, + 2F u = 1(%, 9) (1.40) 


(with constant A, B, ..., F) the corresponding relation, centred on a mesh point 
P, say, must in general involve also the values at five neighbouring points 
P,,..., P,; only in special cases does the number reduce to four. If we denote the 
expression in the pivotal values by 


5 
Q= 1 Ay Uy, 
v=0 


where u, is the value of u at the point PF, with co-ordinates +,, y,, and expand 
these function values by TayLor’s theorem at the point A, (which, for simplicity, 
we take to be the origin x)= 0, Yo= 0): 
5 5 5 5 
Ou Ou 1/(@u 
QO = % a, +(3=] ay 2+ (5 Ay Vy + (Sa > ar: 
ps ge 2 ae ms 2 \ 0%? Jo =p 

then by comparing with the given differential expression L{u] we obtain (with an 
arbitrary constant @) the six equations 


5 6 
Metre eA Pa a Sa 4,73 = eC, 
v= v= 


5 5 5 
D4, % = oD, D4, = @E£, 4, = eF 
v=0 v=0 0 


for the a,. Since a) appears in the last equation only, the other equations provide 
five linear equations for a,,..., 4s. We now ask in what circumstances just four 
neighbouring values, say 4,,..., % (so that a,= 0), will be sufficient. With ag=0 
the first five equations constitute five homogeneous equations for a), dg, 43, 44, Q 
and will possess a non-trivial solution if and only if the determinant vanishes: 


ne ee 


Vy %2Vg %3Vg %4 V6 
yi vi V3 Ma 
xy Xs a3 “, 
V1 3 Vs Va 


2 
x4 


mdb owe 
I 
° 


There are therefore five constants a, 8, y, 6, €, not all zero, such that 


(1.41) 


wa? + Bxpyp rey s} | OxpuneoypemO for jemel, 20574 i 
and 


aA+BB+yC}+dSD}+eE=0. 
This means that the four points P,, P,, P,, P, lie with P, on the conic 
axtt+ Bey +yy?+ dx + ey =0, 


where «, 8, y, 6, € must satisfy the last equation of (1.41). 


1 See R. v. Mises: On network methods in conformal mapping and in related 
problems. Nat. Bur. Stand., Appl. Math. Ser. 18, 1—7 (1952). 
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For the equation V?2u—=r(z, y), in which A=C, B=D—E=o0, we have 
y= a and the conic is a rectangular hyperbola; the degenerate case of a pair 
of orthogonal straight lines is the conic used with a rectangular mesh. 


1.9. Solution of the difference equations by finite sums 


We present the method! by describing its application to the first boundary, 
value problem of potential theory for a rectangular region: V2u=0 in O<Xa+<a 
OSySb and wu prescribed on the boundary. For a mesh with the points 

a ee b 
M+1°’ ~—N+1 
(j= 0,1,...,.M@+1; k=0,1,...,N +4) 


the difference equations [(1.3) with a; ,=c;,=1, d; p= ¢; ,= 8i,k=1j,k= 0] have 
particular solutions of the form 


aj=fh, Yyy=kl, h= 


AF sin path ; 


where A, 9 = ail 


l 
and r = ae are related by the equation 


2r2 (cos @ — 1) + (4+ 3-2) =0. 


For given y and 9 this yields two values for A: 


Pen 9 to 
= ’ = — i, 
he 
where w= 1 —1#*(cos g — 1). 


Consequently the finite sum 


M : 
w= sin "21" (Baha + Ondbe, (1.42) 
in which P;, Q, are constants to be determined, is a solution of the difference 
equations. It vanishes on the boundaries ¥ = 0 and *=a and by suitable choice 
of P,,, Qj, can be made to take the prescribed boundary values of u on the bound- 
aries y=O and y=b. If wu” is the corresponding finite sum which vanishes on 
y =0 and y=6b and takes the prescribed boundary values on *=0 and #=a, 
then “’+ u” will be the required solution of the difference equations. 


To determine Py, 0}, we first put y=0 and obtain from (1.42) 
: a Fe SC 
u(jh,0) = > (Fy + Q,) sin ——.. 
n=l a 
Thus the quantities P, + Q;, are the coefficients in a harmonic analysis of the given 
function u(jh,0) and can be determined by any of the well-known methods 
(RUNGE’s scheme, etc.). Similarly, putting y=b, we have 
Shp: , _ aagh 
u(jh,b) = ¥ (Be Ata? + Qn Aaa) sin — 
n= 

and the quantities Pj AN t1 + 0, AN +? can be determined in the same way. We 
then have two equations tor P, and Q). The wu values at the individual mesh points 
can be calculated from the difference equations once the values on two consecutive 
rows have been obtained by evaluating the finite sums. 


a Hyman, M. A.: Non-iterative numerical solution of boundary value problems. 
Appl. Sci. Res. B 2, 325—351 (1952). 
24* 


372 V. Boundary-value problems in partial differential equations 


Similar finite-sum solutions can also be used for the second and third boundary- 
value problems and for differential equations of higher order with constant coeffi- 
cients (the biharmonic equation, for example). The method can be carried over 
to problems in three or more dimensions by using multiple sums. 


1.10. Simplification of the calculation by decomposition of the finite- 
difference equations? 


Solution of the difference equations corresponding to a linear boundary-value 
problem with a differential equation of the form (1.2) can often be simplified as 
follows. Firstly, in addition to assuming the existence of a solution, we assume 
that the linear difference equation associated with a boundary pivot P as a 
representation of the boundary condition involves, in addition to the value U(P) 
(which must occur), only the approximate values U at neighbouring pivots. 
Those pivots P; (i= 1, 2,..., ») for which the value of U is not given immediately 
by the koundary condition are now divided (chequer-wise) into two sets A (?=1, 
2,...,p; we can take pS}n) and B (i=p+1,...,m) such that no two neigh- 
bouring points belong to the same set [the values U(F) are classified accordingly 
as A values or B values]. Then, multiplying each of the difference equations by 
a suitable constant if need be, we can put the system of equations into the form 


n 
—aU;+ 3 bj, Up + 5; =0 (AN ane PD) (1.43) 
k=p+1 
ZB binte—aUit sy=0 (Si= Pee ent) (1.44) 


In matrix notation this can be written 


(= B, ) ($4) + G4) =o. 

By | — In—p *B SB 
in which the matrix and vectors are partitioned into sub-matrices and sub-vectors, 
respectively, by lines between the p-th and (p + 1)-th rows and columns, and obvious 


notations are used for these partitions; for instance, I» is the p-rowed unit matrix 
and #4 is the vector of unknowns in set A, etc. We now eliminate the unknowns 


of set B by pre-multiplying the system by the matrix ee) this transforms 
n—p- 
Fi 
the original matrix into the ‘‘decomposed”’ matrix | ez ia Bie? | - \ 
2 | —~ inp 
In this way we obtain a ‘‘reduced system’’ for the unknowns in set 4: 
p % ” 
—oU+ DB Ue + o;=0, Bir= DY dipdjx, Gee asit L dis; 
k=1 j=p+1 j=pt+1 
i.e. (¢ = 41, 2,...,P), 
SE yee B,B,) *#4+04=0, oO4=asygt+ Bsp. (1.45) 


Thus we only have to solve p equations; the remaining unknowns are expressed 
explicitly in terms of the solution of these equations by (1.44). Another advantage 


1 The material for this section was kindly made available to me by Herr 
J. ScHRODER [for a detailed presentation see J. SCHRODER: Z. Angew. Math. Mech. 
34, 241—253 (1954)]. 
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of this method is that far fewer iteration cycles are needed to solve the reduced 
system by single-step (or total-step) iteration than to solve similarly the original 
system to the same accuracy in the A values!. 

For differential equations of the form V#u — gu =r, where g is a non-negative 
constant, use of a square mesh (mesh width h) usually permits a simple, direct 
derivation of the reduced system which does not involve the matrix multiplications 
&, B,, By sg. One way of doing this is to use special stencils? which can be con- 
structed by superimposing ordinary stencils. However, if U is known at all the 
boundary pivots, the reduced system can be written down immediately, for the 
coefficients are given by the following simple formulae: 


a=—4-+ gh? 
Bx == number of pivots PF, which are neighbours to both 
P,and P, 
(in particular, B;;= number of pivots P; which are neighbours to P,) 


(1.46) 


o;=a5;+))s;, where the sum extends over all j for 


1 
which Fj and F are neighbouring points. 


Clearly the matrix of the system is symmetric in this case. 


The technique can also be applied with advantage to eigenvalue problems. 
If, for instance, the differential equation reads V?u—gu-+Au=0, where g is 
again a non-negative constant, and if with a square mesh (mesh width kh) U=o 
at all boundary pivots, then by the same procedure as above we can put the dif- 
ference equations into the form (1.43), (1.44) [with s;=0 and .=44+ (g— A) h?, 
where 4 is an approximate eigenvalue, and set up the corresponding reduced 
system (1.45) for which the f;, may be found from the formula of (1.46). By virtue 
of the equation 


aan G0l “1 _} = (— 1)" a"—26 det (— a? 7, + B, B,), (1.47) 

, B, <= In-p 

the “latent roots’’ « of the matrix B = ( 0 | e} may be calculated using the deter- 
2 


minant of the reduced system. They are obviously symmetrically placed about 
a=0, and if (x4/¥p) is a latent vector corresponding to #, then (*4/—%,) is a 
latent vector corresponding to 1%. In the iterative calculation of the greatest 
latent root and its corresponding latent vector the same accuracy is achieved in 
half the number of cycles if the matrix of the reduced system is used rather than 
that of the original system. 


Example: Let us find a function u(x, y) which satisfies the equation Deu + 
Au—Q inside the region illustrated in Fig. V/12 and vanishes on the boundary. 
Using the heavily lined square mesh with mesh width hk 1, we have seven pivots 
P; (marked 1, 2,..., 7 in the figure); set 4 comprises the puvots P, PB, P, and set 
B the remainder (n = 7, p= 3). The numbers f;, (i,k = 1,2, 3) and b,, (i= 4, 5, 6, 7; 

1 See ScHRODER’Ss paper. 

? Following MILNE we apply the term “stencil” to an array of coefficients set 
out in a pattern corresponding to the points whose associated approximate values 

| 4 | 
they are to multiply. Thus the ordinary stencil here is 4 [—«| 1. 


1|_ 
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k =1, 2, 3) are found from the formula of (1.46) (for example: P, and FP, have two 
neighbouring pivots in common so that f,,=2,,;= 2) and from the ordinary dif- 
ference equations, respectively: 


Fig. V/12. Reduction of the system of 
difference equations 


As a check one may calculate the numbers 
3 3 
B;= D: Bix and 6;= 21b,;, and verify that B;= 
j= 
From (1.47) the latent roots « are given by «(«®— 8a4+ 12a?— 3) =0. One pair 
of roots iS a= 1:2523 and ag=—®a,; these give A,=2-7477 and Ag = 5-2523. 
A solution of the reduced system corresponding to a, and a is 
U,= —1:3168, U,=0-4426, U,=1. 


The ordinary difference equations (1.44) (with s;=0, «=a, %,) then yield the 
following values for the remaining U;: 


U,=+01004, U,=F1-0515, QW=F06981, U= + 1-1519. 


Mesh refinement: For the type of eigenvalue problem just considered (Vu — gu 
+Au=0, g=constant>0, U=0 at the boundary pivots for a square mesh) one 
may seek to improve a calculated eigenvector x and corresponding approximate 


eigenvalue A= g+ a (4—«a) by a perturbation calculation starting from the 


known quantities + and « ( this method of improving calculated values by means 
of a perturbation calculation may also be applied to the corresponding inhomo- 
geneous boundary-value problem). We make two further assumptions: the latent 
root a is simple and non-zero, and the boundary I consists of complete sides or 
diagonals of the squares of the “‘basic mesh”’, i.e. the mesh with which the known 
approximations x and a were calculated. The diagonals of the squares determine 
a new mesh, the ‘‘diagonal mesh’, which has at least 2n pivots and which takes 
over directly the old pivots P,, ..., B, as the new set 4* of non-ncighbouring pivots. 
Since the Laplace operator is unaltered by a rotation of the co-ordinate axes, the 
coefficients in the difference equations are similar except for the smaller mesh 
width h/V2 and the corresponding reduced system can be written 
2 


(ar Tee BY BY) xhe= 0, ag 2 @ — A), 


where asterisked quantities refer to the diagonal mesh. It can be shown that 
Ay=}5B?4+ 2B 
does not differ greatly from Bf Bg, so we put 


BY BE = A,4+ €A,, 
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in which we shall take ¢ = 1, and solve the equation (— «*? J,,+ Ag+ €A,) #4e=0 
by a perturbation method: we put +4e= q+ £9,+ &¢,+°:: with gy= 4%, at?= 
Mot Ef + eyig+--+ with wy=4a?+ 2% and equate coefficients of powers of e. 
Using the fact that A, is symmetrical we find that 


Mot y= 2a0+7, where r= (R Go» Yo) » R=BEBI—2B= (Fy ae: 
(Yo» Po) 0 |R, 
here (y, z) denotes the inner product of two n-dimensional vectors y and z. 


For the above example the diagonal mesh provides twenty-one pivots as against 
the seven pivots of the basic mesh. We have 


and for «=a, 
Ho + Hy = 64363, Mgt My + Mg = 64746 and py t+ fy t+ Ma + Mg = 6°4670. 


These three numbers lead to the approximate values Af ~ 2-9260, 2:9110, 2:9139, 
respectively (the exact solution for the calculation with twenty-one pivots is 
Ag = 2-9135), as compared with the value A,=2-7477 from the basic mesh. 


§2. Refinements of the finite-difference method 


The derivation and application of the formulae for the methods to be described 
here are for the most part so similar to the corresponding considerations in Ch. III, 
§ 2 and Ch. IV, § 2 that we can be brief and place more emphasis on the generality 
of the methods. 


2.1. The finite-difference method to a higher approximation in the 
general case 
Let a function u(x,, x,,..., %,) be defined in a simply connected, 
closed region B* of the n-dimensional co-ordinate space by an m-th- 
order linear differential equation 
Gert +any 
L[u] a Og, ove, Oy Oxe... Oxtn = t(%,, Bases Xn) (2.1) 
together with linear boundary conditions. For example, we might 
prescribe on certain hypersurfaces J} values of u or of 0u/0x, or, more 
generally, of a linear combination of the partial derivatives of u of up 
to the (m—1)-th order. These surfaces need not lie on the boundary 
of the region of definition B*; it is often convenient to take into con- 
sideration values of the function « outside of the ‘“‘boundary”’ surfaces 
on which the boundary conditions are given. 
For the numerical calculation of « from the given data we introduce 
a system of pivotal points P (j =1, 2,..., N) which all lie in B* (they 
need not be arranged in a regular pattern) and seck approximations U; 


to the values u(P) of the exact solution u at the points P. For the 


376 V. Boundary-value problems in partial differential equations 


solution of this problem we set up a system of linear equations for the 
U;. Such an equation is obtained by forming the sum 


N 
mm C,u(B) 


and determining the constants C, so that it approximates the differential 
expression of (2.1) at a point P. We say the equation is written for, or 
corresponds to, the point B.. 

Each term oa of the sum is expanded by TayLor’s theorem 
about the point B 


| (4 (Fe) — %(F)) sis IS 


iN 0 


u(B) =u(B) + 


u 2 
tA 3¢ P) — «,()) (a(R) — aE? 


», w=1 
+... + terms of the 7-th order + remainder term 


and the whole sum >) C,u(P) then rearranged in terms of 4(F) and the 
partial derivatives of u at the point PB: 


N 
Cel Bare Se + remainderterm. (2.3) 
=1 Oy +++ On SP - 

The new coefficients B, ,, depend linearly on the C,. If A is the 
smallest non-zero number among the values of the quantities 
|x; (P,) — x;(B)|, and M,,, is the maximum in B* of the absolute values 
of all the (ry +1)-th partial derivatives of u, then the remainder term 
can be expressed in the form 8D, h’*? M,,,, where |@| <1 and D; depends 
on the positions of the points P, but not on #; when the disposition of 


the points P, is known, numerical limits can be given for the D,. 


Our object is to make the expression on the left-hand side of (2.3) 
as accurate a representation of the differential expression L[w] in (2.1) 
as possible; we can then write approximately 
z C,u(B) ~ L{u(P)| =t(B) 
and take 
x 
2, C,U, =#(F) (2.4) 
e=1 
as one of the equations for the U;. 
To achi bject we try to make the coefficients of 27" ***™ 
o achieve our object we try to make the coefficients o bes... ome 


n (2.4) and (2.3) agree for all derivatives of up to as high an order as 
possible. First of all we must have 


A. se a ( O- @:5) 
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i.e. we must have agreement for C=, +a,+---+a,=0,1,2,...,m at 
least. This minimum requirement yields the special case of the ordinary 
finite-difference method, for which (2.3) becomes 


N 
2 Com(R) =L[m(B)] + OD; ht Mas. 


The linear equations given by (2.5) admit of simple solutions! in 
which many of the C, are zero and the few non-zero C, correspond to 
points F lying near P.. 

Here we are more interested in higher approximations, i.e. those for 
which the order of the remainder term is greater than m-+-1: 


N 
pA u(P) = L[u(B)] + 8D, WM, 41, (2.6) 


where r>m. To this end, we add to the equations (2.5) for the C, the 
further equations 
By. eg =O for m<aaeer. 


ay 


Insertion in (2.4) of a set of numbers C, which satisfy these equations 
yields one of the desired equations for the U,. 

Further equations of a higher approximation can be derived by 
finding a different set of numbers C, which satisfy the necessary equa- 
tions? or by using a different point Pas ‘‘centre’’ of the Taylor expansions. 
In addition, linear equations for the U; may be derived in the same way 
from the boundary conditions. 

One endeavours to set up as many equations for the U; as will yield 
a system of linear equations with a non-zero determinant. 


2.2. A general principle for error estimation 
If we have such a system of equations for the U;, then in principle 
we can obtain estimates for the errors 
If we assume that the solution uw possesses partial derivatives of up to 
and including the (y + 1)-th order, then insertion of u into (2.6) yields 


N 
> C,u(B) = L[u(B)] + OD, W41M,,, = (PB) OD, WOM, 3 


g=1 


1 Provided that the distribution of pivotal points in B* is sufficiently dense 
the number of C, at our disposal will be far greater than the number of equations 
to be satisfied. 

2 Strictly we ought to write cl), 1) pl) say, for even with the same 
point F several sets of values for the C, are possible. Since misunderstanding is 
unlikely, we use the simpler notation with fewer indices. 
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then subtracting from (2.4) we find that the errors ¢; satisfy the equation 
N 

2X Ce £0 SS =o, We ae (277) 
e= 


Thus, afart from the different right-hand sides, the errors e, satisfy 
the same system of equations as the approximate values U;. Since the 
determinant of the coefficients was assumed to be non-zero, we can 
solve the system of equations (2.7) for the «,. 

For the finite-difference methods described here for the numerical cal- 
culation of the solution u of a linear boundary-value problem to a higher 
approximation, the theoretical possibility of being able to obtain error 
estimates follows from the possibility of being able to apply the method in 
the first place, provided that u is assumed to be differentiable sufficiently 
often in the region B*. 

Uniqueness of the solution u need not be assumed: what we estimate 
is the departure of our approximate pivotal values from the values of 
a solution whose partial derivatives of the (7 +1)-th order are bounded 
absolutely in B* by the constant M,,, in (2.7). As regards the difficulties 
which attend the estimation of M,,,, cf. the remarks made in Ch. IV, 
§ 3.3. 

2.3. Derivation of finite expressions 


The Taylor expansion method of § 2.1 provides a technique for setting 
up a finite expression to represent any given differential expression. 
Here we describe an operator method which shows that there exist 
finite expressions of an arbitrarily high order of approximation, Le. 
expressions with remainder terms of order r-+-1 for any prescribed r. 

We select a typical term 

Obit Kato t an yg 

Oak bam... Oak 2:8) 
and take our pivotal points at the nodes of a square mesh of mesh 
width #. We can then use the displacement operator £; which transforms 
a function 4 (%,, %g, «2.5 %,)ainto 0G, iy, ...peer, , Spee, , -. . eR) 
This operator! obeys the laws of ordinary algebra and also commutes 
with the differential operators ¢%/01%. Raised to an integral power p 
(positive, negative or zero) it has the effect 


Eb 16(%1, %qy <02, Bj, +0 5p Rae Ma) s+: Soa eas oe eee) 


In the equations between operators which we write in the following 
we imagine the operations to be performed on rational integral functions 
1 STEFFENSEN, J. F.: Interpolation, p. 4 et seq. and p. 178 et seq. Baltimore 


1927. — Bruwier, L.: Sur une équation aux dérivées et aux différences mélées. 
Mathesis 47, 103—104 (1933). 
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v(m, %g,++-+,%,) Which are of degree not greater than 7 in each of the 
independent variables. This avoids having to take the remainder terms 
into account each time. 


According to § 2.2 of Chapter III there exists for each individual 
operator 0“/0x% a finite operator? 


[2] 
= = p Aer (2.40) 
Co) la 


for any given integer 7. 

If we multiply this equation by 0/0 x?* (k=-2), then, since Efv is 
also a rational integral function of x,, x.,..., x, of degree not greater 
than 7 in each of the independent variables, we can replace 


O% 
ot Mea by DAM ESESv; 
k og 
consequently 
om te 
= AW Eg Af Ei 
ax% Ox% 12 ttt 2 ee 
and 
Md [él (i Out +an 
ey De oe. oe oe 
a le 


for any one of our functions v(%,..., %,)- 

If the product in (2.11) is now multiplied out and applied to a func- 
tion u, and then each term expanded by Taytor’s theorem with a re- 
mainder term of the (r +1)-th order, exactly as in § 2.1, we have 


n 
es Gute +an y 
ipl > ADES| 4 ears oa 
t=1 e Upen ie 
Prt +bny 41 
ae oe Bz, ores By ah B:... abn a OD; h’ M, +3 
Bite +BaS? Ox 5p Kn 


(notation D,, M,., as in § 2.1). The constants By, ,,..,g, are the same 
not only for all our rational integral functions, but also for all func- 
tions « which possess partial derivatives of up to and including the 
(y +1)-th order. Now take ™ to be any rational integral function of 
(total) degree not greater than 7; then the right-hand side must be 
zero since these functions are included among those for which (2.11) is 
valid. Further, M,,,=0 for these functions, so if we put # -constant, 
we deduce that Boo ..9=0; similarly we can put 4=4%;, U=%;%, 


1 The customary notation [%] is used for the greatest integer which is not 
greater than x; for example, [2.5] = 2, (2]=2, [—2.5]=—3. 
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u=%x;%,%,,..., from which it follows that all Bs, 3,=0 for Bj +f.+ 
---+8,<r. Thus for all functions # with continuous partial derivatives 
of the (y +1)-th order we have 


n{ (al " 
iF —_ Ctr tetany 1 
IT y Ay ES i Oxh... Onan + 8D; h’* M,41- (2-12) 


Lem T a) 

Although this operator method! shows the existence of finite expres- 
sions of an arbitrarily high order of approximation, the Taylor expansion 
method of § 2.4 is often more profitable in practice, for it can often be 
used to derive simpler expressions involving fewer points?. Several 
finite expressions for the frequently occurring differential expressions 
V2u and V*u are given for two independent variables in Table VI of 
the appendix (also for three independent variables for V?). 


2.4. Utilization of function values at exterior mesh points 


With the finite-difference methods of a higher approximation it often 
happens that a finite equation written down for a mesh point near the 
boundary involves approximate values at mesh points which lie outside 
of the fundamental region, i.e. the region 
enclosed by the boundaries on which the 
boundary values are prescribed. To render 
possible the elimination of these values 
one usually employs finite equations of a 
lower approximation on the boundary. 
This is illustrated in the following ex- 
amples. 


Fig. V/13. Utilization of exterior mesh iE Caseden ain paola sa Dinamap I, 

points § 1.5, which was to determine a potential 

function with given values on the bounda- 

ries shown in Fig. V/4. If we take h = 4 and make use of the symmetry 

of the problem, we have just three unknown values a,b,c at the 

points indicated in Fig. V/13, but finite equations of a higher approxi- 

mation written down for these points will involve function values outside 

of the fundamental region — in the simplest case, the values «, 8, y;&, 
A, B asin the figure. 

The unknown value B is included because of the singular behaviour 

at the re-entrant corner. The section of the « surface in the vertical 

plane containing the line BbB will have a discontinuous slope at the 


1 Operators are used by W. G. BickLeEy: Finite-difference formulae for the 
square lattice. Quart. J. Mech. Appl. Math. 1, 35—42 (1948). 

2 Examples for comparison of the methods can be found in L. CoLLatz: Schr. 
Math. Sem. u. Inst. Angew. Math. Univ. Berlin 3, 18 (1935). 
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corner as shown by the heavy line in Fig. V/14. Consequently the true 
value of 1 at B is not consistent with a polynomial representation, 
whereas a fictitious extrapolated value can be made so. 

Using the finite expression for V?u 
given in Table VI of the appendix we 
obtain the equations 


— 60a + 16(6 +1+4-+4 0) — 
—(c+A+a&+2) =0, 

=60b + 16(¢ +4 +a+0) — 
—(0+B+4+8)=0, 

— 60¢c +16(0+6+6-+0) — Fig. Wii4. Introduction aS eats 
= AY Siriaas) O° 

To eliminate the extra unknowns we express them in terms of a, b 


and c by means of the ordinary difference equations corresponding to 
the boundary points: 


—4x0+0+a++0+a=0, yields «=—a, 
and similarly weobtain B=—b, y=— Cc, 

—4xi+a4+1+4+0=0, yields «=1-—a4, 
—4xi+14+A+1+a=0, yields A=2—a4. 


Similarly we put B = 2— as though the value 1 on the line G in Fig.V/13 
extended beyond the re-entrant curner. 


With these substitutions we find that 


—57a+16b) —c=— 21, 
32a — 116b + 32c = — 27, 
—a+16b — 29c =0, 


and hence 
2571 ; __ 2265 _ o. le oes 73. 
ge 08406, «= eae oe 042671, C= wae 3 


If more accurate values are needed, the calculation can be repeated 
with a smaller mesh width 4; the larger system of equations which 
arises can be solved iteratively. 


II. A boundary-value problem whose physical background is sketched 


in § 4.2 is the following: 
V*4=——1, tee —u on the boundary of the square |x|<4, |y|S1, 
v 


where y is the inward normal. To illustrate the method, we use the 
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rather large mesh width h=2; using the symmetry we have the five 
unknowns a, b, c,d, e (Fig. V/15)._ We describe three methods. 


A. The ordinary finite-difference method. 
The ordinary difference equations for a, b and c are 
—4a+4b+=0, 
—4b+¢a+2c+d +H =0, 
—4c+20+2e+/2=0; 
to these we add the equations corresponding 


to the boundary conditions: 
bd sued 
ae eh ea 
ae 


b(2—h) =d(2 +h), 
Fig. V/15. Notation for the example 


treated by several finite-difference and similarly 
methods 


c(2— h) = e(2+h). 
Solving these equations we obtain 


B. A finite equation of higher approximation could have been written 
down for the point a. If we therefore replace the first of the equations 
in A by the equation 


— 60a + 646 — 4d+12h7=0 


and use the remaining equations as they are, the solution of the new 
system of equations is 


388 336 292 
== SS (0 f ee 105 O2F CSE == 0:6 62, 
= 5 0-8453 io 0:71 Ae 3 
diag’ b, ad & 
2 2 


These values are worse than those obtained in A, which is rather 
surprising at first sight. This demonstrates the unadvisability of using 
a very accurate equation at one point when very crude approximations 
are retained at others (here at the boundary). We therefore approximate 
the boundary conditions more accurately in the next method. 


C. Method of a higher approximation. 


Here we approximate the boundary condition @u/@r = at the point 
P, say, in Fig. V/15 by putting a parabola through the points a, 6, d. 
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At P this parabola has the ordinate and derivative values 


d—b 


3d+6b—a 
ee. 


Up 3 


? 


which substituted in the boundary condition yield 


3d+ 6b—a d—b _ 
so + WG = 0. 


With h=% we have the more accurate finite boundary condition 
15d=6b+a, andsimilarly 15¢=6c+b. (2.13) 


From these two equations, together with the main equations used 
in B: 
— 60a + 646 —4d+12/7=0, 
—4b+a+2c+d+h=0, 
— 4c+2b+2e+h? —0, 


we obtain 
eae 5787 —={0F 6= 983 = (0h7 — 307 = 0-607 
7 0-8160, 7 0 026, c 7 0-60 Ve 


d =0-3354, e¢=0-2898. 
These values are much better than those found in A and B. 


III. In Example II of §1.5 the 
boundary-value problem 


Ug + Uyy + =a Uy + 1=0, 
u=0 for |%| =} and for |y| =1 r) 


was treated by the ordinary finite- 
difference method for the mesh widths 
h=4,%4,4. Here we apply a method 


of higher approximation for h= 4. With al 2 y 
ine aoaecn a UE yy 16 BS ce Fig. V/16. Notation for the higher approximation 
equations for the three interior points read solution of Example III 
—c+ 16b — 30a—4 — 2a — 30a 6 —c+8b+0 
- : —_— ——— -+4=0, 
3 =F 3 IF rr 6 oF 
16¢ — 300 + 16a _— 2B — 3u0b n 3 Somme Sa ie (2.14) 
3 3) 5 6 
eee Omens is 27 0G tee 8 tA So, 
3 3 3 6 


in which appear the unknown values «, B, y, 6, € outside of the rectangle. 
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These extra values are eliminated by using again the ordinary difference equa- 
tions corresponding to the differential equation for the points P,, ..., P;: 


a+a B+ob yte = 
re td ergge ‘7 +1=0, 
a+o A c+e 3 = 
aia gar eet) eae 1 1 ed c)+1=0, 
by means of which the a, ..., € can be expressed in terms of a, D, c. 


Substituting these values in (2.14) we obtain three linear equations for a, b, ¢ 
which have strongly dominant diagonal coefficients and are best solved by iteration: 


— 4394a + 14006 — 98c¢ + 285-5 = 0, 
1364 — 580b + 184c + 35 =0, 


— 76a+ 1520b — 6508c¢ + 431 =0. 
Their solution is 


a = 0:09878, 
b = 011249, 
c = 0:091 34. 


2.5. Hermitian finite-difference methods (Mehrstellenverfahren) 


These methods employ formulae of the Hermitian type discussed in 
Ch. III, §2 and Ch. IV, § 2.3; their derivation here is very similar, though 
rather more general. 


We consider a boundary-value problem as in §2.1, and with the same 
notation as used there seek approximate values U; for the values «(P) 
of the exact solution at the pivotal points P. distributed (not necessarily 
in a regular pattern) throughout the region B*. 


We write the differential equation (not necessarily linear) in the form 
(2p, --+2 S ps %, Ly 10d, Ly (e], 22, Lee en, (2.45) 


where L,[u], L,[~],...,L,[w] are given linear differential expressions 
in 4 as in (2.1). For each of these differential expressions, and also for 
any further linear differential expressions L,,,[#], ..., L,[u] which may 
occur in the boundary conditions, we write down expressions of the form 


N N 
®,[u] = 2X Ce, 5 (2) + og [inp (omen... g) IG) 
e= e= 
and expand them by Taytor’s theorem in terms of the values of « and 
its partial derivatives at the point PB. The constants C,, and D, , are 
to be chosen so that the expansion vanishes identically to as high an 
order as possible. For most practical calculations one will naturally 
choose the pivotal points in a regular pattern and use expressions ©, 
for which only the C, , and D, , corresponding to ‘“‘mesh points” near 
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P. are non-zero. The Taylor expansion and determination of the coeffi- 
cients are illustrated in detail in Ch. IV, §§ 2.2 and 2.3 for the differential 
expression 
_ Ow 1. Ou 

Expressions of the form (2.16) are given for the individual derivatives 

Oru 

“Ox? 
(for small v) in Table III of the appendix and for the operators V? and 
V*in Table VI". 

An approximate equation 


= p=4,...,N 
Ens Ue foie +¥D @,s U4 =0 (! 7 (2.17) 
e=1 A 


9S Sdn coor 


where U, , denotes an approximate value of (L,[«])p,, is now written 
down for each point P and for each expression L,[w], making N xq 
equations in all. We have N x(¢+1) unknowns U,, U,,,, so N further 
equations are required. These are obtained by momen down the boundary 
conditions for those points P, lying on or near the boundary and the 
differential equation (2.15) with (L,[«])p, replaced by U, , for those points 
P lying “further nay Whether the differential equation or a 
boundary condition is written down for any specific point will be 
decided on the basis of the particular problem under consideration. 


For a linear differential equation L[u] =r(x,,..., %,,) a more general 
form? of the expression (2.16) can be used, namely 


Diu) = 3 Cul B) +E Py (EU) y+ 2, 3 Fen (MLL) 


where the M, are chosen operators and the E, , are constants to be 
determined in the usual way (formally the second sum is included in 
the double sum and could therefore be omitted). In the corresponding 
approximate equation we replace (M,[L[w]])p, by (M,[7])m, which is 
known. The inclusion of these extra terms offers the possibility in many 
cases of achieving a higher order approximation without involving any 
extra pivotal points. Naturally a high accuracy formula of this type 
will only be used when the solution possesses continuous derivatives of 


1 See also L.Cortzatz: Das Mehrstellenverfahren bei Plattenaufgaben. Z. 
Angew. Math. Mech. 30, 385—388 (1950) and R. ZurMUHL: Behandlung der 
Plattenaufgabe nach dem verbesserten Differenzenverfahren. Z. Angew. Math. 
Mech. 37, 1—16 (1957). 

2 Cottatz, L.: Z. Angew. Math. Mech. 31, 232 (1954). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 25 
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a sufficiently high order. As an example we mention the use of the 
expression 


Blu} = 204, — 4D my — D+ (340 2u, — DV?) + 
+ (17740, + 4m) = 0 (08) 


for the two-dimensional Poisson equation, in which L[uj=u,,+4y,,; 
it is based on a square mesh with mesh width 4 and makes use of just 
one operator M, = V?. The notation used is as follows: @ is an arbitrary 
mesh point P, u,=u(P), >\™, is the sum of the u values at the four neigh- 
bouring points and >), is the sum of the wu values at the four mesh 
points at a distance /2/ from P; and similarly for } V?u,, etc.?. 

Other ways of improving on the accuracy of the ordinary finite- 
difference method are considered by Woops”. For the differential 
equation V?4=r(x, y), which he treats in detail, he suggests a method 
which is effectively an iterative solution of the system of equations 
obtained from the first Hermitian formula in Table VI of the appendix. 
This formula is easily derived by Taylor expansion, and with the same 
notation as above can be written in the form 


4u,— > uy + h?r, = D[u] + O(AS), 
where 


D{u] =4 (Su,— 2D m+ 4) —~ (Sy — 41). 


First of all, approximations U’ are obtained from the ordinary difference 
equations 
4U, — 2, U; + hr, =0 


(together with the boundary conditions). With these values U’ the 


, 


quantities D[U’] are calculated and then corrections 7” obtained from 
the inhomogeneous difference equations 


4u, — >», = D[U'] 


1 A special formula of this type, namely 
hf 
20ug— 4) 4, — Diu, + 6427 F82u, — : VAu, =O(h®), 


was given as early as 1934 by Su. MIKELADZE: Sur lintégration numérique 
d’équations différentielles aux dérivées partielles. Bull. Acad. Sci. URSS. 6, 
819—841 (1934) (Summaries in French and Russian); cf. also equation (2.21) of 
§ 2.7. Further formulae of this type can be found in SH. E. MIKELApzE: Uber die 
numerische Lésung der Differentialgleichung u,,+ ty) bu,,6 @(% vec). CR. 
(Doklady) Acad. Sci. URSS. 14, 177—179 (1937), also 181—182. 

2 Woops, L. C.: Improvements to the accuracy of arithmetical solutions to 
certain two-dimensional field problems. Quart. J. Mech. Appl. Math. 3, 349—363 
(1950). 
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(with homogeneous boundary conditions), so that the new approxima- 
tions U’’ == U’-+-v’ satisfy the equations 
mG — >, ey DU’). 


If need be, further corrections v’’, ... can be calculated in the same way. 


2.6. Examples of the use of Hermitian formulae 


In order that the methods may be compared, we use the same ex- 
amples as in § 2.4 (and in the same order). 


I. From Table VI of the appendix the Hermitian equations for 
V2u—=0 centred on the points a, b,c (notation as in Fig. V/13) can be 
written down immediately: 


40a — 8(6+1+4+0) —2(1+1+0+0) =0, 
406 — 8(c +1+a4+0) —2(6+1+0+0) =0, 
40e — 8(0+-5 +6 +0) —2(0+1+0+40) =0. 


Here no exterior pivotal values appear, in contrast to § 2.4. We obtain 


i ede S a 
a= 4, =0:48193, i =, 6S, 0-213 86. 


II. With the notation of Fig. V/15 the Hermitian equations read 


40a — 32b-8e =~, 
40b — 8(a + 2c +d) — 4(b +) =~, 
40c — 16(b +e) —2(a+ 2d +f) =~; 


to these we must add the equations (2.13), corresponding to the boundary 
conditions, and also the analogous equation 


1isf=6e+d. 
Solution of this system of equations yields 


_ 147477 _ 6 
~~ 176484 0-899? 


—0-7199, c=0-6234, d=—0-3436, e=0:2974, f~=0-1418. 
III. For the boundary-value problem 


Ug t Myy + SS wy ti=0 (2.18) 


AS 
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with «= 0 on the sides of the rectangle {x| <4, |y| <1 we use a different notation 
from § 2.4. With the mesh width h=4 we have the unknown function values 
U,, U;, U, (see Fig. V/17) and the unknown values Uy, Ug, Us, U;, Ug of the partial 
derivative in the y direction; the corresponding 
values of V2%, which we denote by V?,..., Ve, 
can be expressed in terms of the U; by means of 
(2.18): 


0 0 oft Q 0 


Fig. V/i7. Notation for an example 
treated by the Hermitian method V2 SS 4 £ Og 


while for |x] = $ we have V2u = — 1 since uy= 0. Thus the Hermitian equations read 


40U,— 8U,—2— 14 U; + 4 (—4—8U;—4U)) =0, 

40U,— 8U,— 8U,—2—§U;+ 3(—4-4U—  U) =0, (2.49) 
40U,—8U,— 2-4 + 1 (-4-4U; — Uy) =0. 

According to the general procedure described in § 2.5 one would now write 


down a set of Hermitian equations for the U;’; from Table III of the appendix 
such an equation centred on y= 2 for example, would be 


—U;-—4(G+4Uj+ U3) =0. 


However, in the present simple case it is more convenient, and at the same time 
more accurate, to put a fourth-order interpolation polynomial through the five 
function values U; and use its derivatives at the points y= —1, — 4, 0, }, 1 to 
express the Uj’ in terms of the U;. Thus, evaluating the derivative of the polynomial 


U(y) = [— # Gy(2y — 1) + U,(49*— 1) — 4 y(2y + 1)) (y— 1) 
for these values of y, we obtain 
Uj = 8U,—6U,+8U,, Uzp=—§U,43U,—U,, Us=—4U,4+44,, 
Up= U;—3U,+§U,, Us= —$U,+6U,— 8. 

Substitution of these expressions in (2.19) yields a system of equations for the U;: 
27072 U, — 6945 U, + 368 U, — 1980 = 0, 
— 3138 U, + 19845 U, — 4822U, — 1485 = 0, 
— 228 U, — 1845 U, + 14068 U, — 1080 = 0 


which may be solved conveniently by iteration since it has strongly dominant 
diagonal coefficients. The solution is 


U, = 010098, U,=0:11346, U, = 0-09329. 


IV. We mention here an interesting theorem due to Pétya!. Let a bounded, 
simply connected region B in the (x, y) plane be covered by a square mesh of mesh 
width h and Ict B’ be a region contained within B and bounded only by sections 


' Pécya, G.: Sur une interprétation de la méthode des différences finies, qui 
peut fournir des bornes supérieures ou inférieures. C. R. Acad. Sci., Paris 235, 
995—997 (1952). 
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of mesh lines. If A, is an eigenvalue of V?u + Au =0 in B with u = 0 on the boundary 
I of B, Ay the corresponding eigenvalue for the region B’ and A , the corresponding 
eigenvalue of the particular difference equations 


her § Us fae, i 


Ah 
+ “42, (6 Ui, + Uisagt Us4a,gt1+ Uy j4at Ups gt Pap enae U; 7-1) =O 


for the region B’, then A,<A,<A, for all k for which A, exists. The corresponding 
result for the ordinary difference equations does not necessarily hold. 


2.7.Triangular and hexagonal 
mesh systems 


There are many types of boundary 
for which it is expedient to use a non- 
rectangular mesh. For illustration we 
select a mesh of equilateral triangles 
(Fig. V/18) and describe the derivation 
of finite expressions for the operators 
V* and /*. 

Let O be a general mesh point. We Up 
start by expanding the function values 
at the neighbouring mesh points Ug 
P,Q, ... into Taylor series centred on 
O; for example, with the notation Us 
a=th, B =4)3h, where h is the mesh 
width (here the length of the sides 
of the equilateral triangles), the value 
at P (Fig. V/18) has the expansion Fig. V/18. Triangular and hexagonal meshes 


Up=Uytau,+ Bu, + 


Se Ta 2p, + 24 Busy + BPuyy) + 


+ sf loiter 3° B Urey ie 30 Buz yy bf BP ttyyy) + (2.20) 
at a (04 ty geet 4038 Ug 6.0? BP, yy p40 Petey yy+ 
+ B* tty yyy) roc 


If we write down the corresponding expansions for the other five 
mesh points at a distance h from O and add all six together, most terms 
cancel out because of the symmetry and we are left with the result 


2 hA 
D up = 6%, + 3 Vu -/- Viugter:. (2.21) 
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Similarly, addition of the corresponding Taylor expansions for the 
six function values at the mesh points at a distance /3 from O yields 
the formula 

27 ht 


D thy = 6g + 2 V2 ty + 2 Vtg + --, (2.22) 


which can also be derived immediately from (2.21) by replacing / by 3 h. 


Stencil for 9h?74uy Stencil torgh 7 "tp 
-7 1 


Fig. V/19. Stencils for 7*« and 74 
Thus as a first approximation for V?%) we have the formula 
3h? De 4 
Dip 6%, = uy + O(h) (233) 
and as a second approximation the formula 


— 48u 9+ 9D) Up — D) Ug = 9h? V2u9 + O(AS), (2.24) 


which is obtained by eliminating V4u) between (2.21) and (2.22). 
Elimination of V2, between (2.21) and (2.22) yields an approxima- 
tion for V4: 
12u)— 3D Upt Di tg = ht V'uy + OAS). (2.25) 


These results are best visualized as stencils of coefficients laid over 
the corresponding pattern of mesh points as in Fig. V/19; such stencils 
are also helpful in setting up the system of difference equations. 

For a mesh of regular hexagons (“honeycomb pattern’’) we obtain 
in the same way 


tty + Ug + Us = 3My + ~ V2u, + Oh), (2.26) 


where the function values #9, #,, 4%, #3 correspond to the points indicated 
in Fig. V/18. 
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2.8. Applications to membrane and plate problems 


Example I. Consider a uniform plate in the shape of a trapezium 
(sides of lengths A, A, A, 2A and angles of 60° and 120° as in Fig. V/20) 
with its long edge clamped and its other edges freely supported. If it 
is subjected to a uni- -b -@ es) 
formly distributed trans- 
verse load of intensity p 
per unit area and its 
flexural rigidity is N, 
the transverse displace- 
ment satisfies the dif- 


ene LES 


and the boundary con- \/~" \/ \W/__\ i 


ditions Fig. V/20. Notation for the trapezoidal plate 


_ ou 
oy 


0 along the clamped edge (y in the direction 
of the inward normal), 


Uu 


u = V2u = 0 along the freely supported edges. 


From (2.25) the finite equations for a triangular mesh with mesh 


width h =4A read 

vag LE 
12a—3b—3c+d=k=—- >, 
—3a+10b—2c—3d=k, 
—3a—2b410c—3d=k, 


7 =o — 6c 11d =x, 


where a,b,c, d are the approximate function values as indicated in 
Fig. V/20. 

In these equations we have used the values at exterior mesh points 
inferred from the boundary conditions (symmetrical values about the 
long clamped edge and antisymmetr ical values about the freely supported 
edges — see Fig. V/20). 

Solution of the equations yields 


_ 58 ae Bart's 
f oe Oe oa h 4 241 ee 
Le, vi 
4 ; 
a = 0.001671 24, b= c= 0.000737 27, d = 0.003314 24 


A finer mesh with h=iA is used in Exercise 9 of § 6.7. 
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Example II. The normal modes of vibration of a homogeneous 
membrane stretched over a frame in the shape of a regular hexagon H 
with sides of length L (Fig. V/21) are given by the solutions of the 
eigenvalue problem 

V2u=—Au ind, 


“ =0 on the boundary of H. 


A. Triangular mesh with h =4L. Here we have nineteen mesh points 
inside of H. For the corresponding function values we adopt the nota- 
0 Yo, tionwa, b, cy...) 2, 0, .- Saeeasen 
Fig. V/21, in which the same letter 
is associated with points lying 
symmetrically about the lines G, 
and G, (Fig. V/21) and dashes and 
6, bars distinguish on which sides of 
the lines they lie; for example, the 
image of c in G, is c’ and in G, is ¢, 
and the image of ¢ in G, isc’. A 
general calculation would lead to an 
algebraic equation of the nineteenth 
degree for the approximation A to 
the eigenvalue A, but by postulating 
the various symmetries which can occur we can achieve our object 
with equations of a very much lower degree. 


0 '6 0 


Fig. V/21. Hexagonal membrane 


A1. Symmetry about G, and G,. All bars and dashes can be omitted 
since c=c’=¢ =¢’ etc. and we have just seven equations fora, b,..., ¢ 
and A. With »=6— #$/?A these read [from (2.23)] 

yva=26+ 4c 
yh=a+t+2c+e42f, 
ne =saih be hid “Ff ge 


vd =2c+ 2g, 
POZA 2}, 

yf =b+c+e+g, 
ye=ctdf. 


We can take out the factors (v+1) and (v?— 3) from the determinant 
of coefficients D(v) by combining several rows and columns, and the 
condition on » for a non-trivial solution becomes 


D(v) = (v +4) (v? — 3) (vt — 2n8 — 1592 4+ 24) = 0. 
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Table V/7. The normal modes of vibration of a hexagonal membrane 


393 


Triangular meshes Various hexagonal mesh systems 
= GD | GB | 
=a ea | om | 
Mesh width Mate eye bat 
eenetry nme AL’ | » Als | >» Ae 
71, Gg = 
full |1+72 7-030 | 26750 6-933 | V3 5-072 
ymm. | % 
are | 
3°355 15-87 A+VB 46:58) 2-214 16:76/ 0 12 
a <(D 
marco | 
HS" 28-58| 1-68 28-2 
A, G, . 
full (O) 1—Y2 41:0/1-55 31-0 |—V3 18:9 
ymm. 
G, GK) —14+Y2 31-0) 1:21 38-2 
a © 
“1 1-/6 
—0:476 38°8 45} 43°4/1 42:7 
G, 
a, G. : 
-* AVE 55-4 | 0-54 525 
G,, Gy ’ 
al 1-63 45:8 —1-21 90 
symm. © 
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The largest root of this equation gives the “gravest’’ mode (smallest value 
of A); this corresponds to the special case of full symmetry (six axes of sym- 
metry), in which the displacements are all of the same sign and nodal lines are 
absent. The corresponding values are given in the first row of Table V/7. The 
subsequent rows show the corresponding results for the higher eigenvalues in 
increasing order of magnitude; sketches of the corresponding nodal lines are also 
given. These lines of zero displacement can be obtained approximately from the 


Fig. V/22. A higher mode with nodal line Fig. V/23. Hexagonal mesh for the calculation of 
normal modes 


corresponding approximate mode form given by the ratios a:b:c:d:e:f:g; these 
are easily calculated for each y value from the homogeneous equations, say by 
putting one of the non-zero values equal to 1. This is shown in Fig. V/22 for y= )3. 
A2. Symmetry about G,, antisymmetry about G,. Here the dashes 
can be omitted, as before, but omission of the bars is to be accompanied 
by a reversal of sign; thus, for example, c=c’=—¢—=—c¢’. Further 
a=b=e=0, and we are left with just four equations for c, d, f, g: 


yve=c+d+f+g, 


vd =2c-+ 2g, 
vf=c+g, 
ye=ct+d+f. 


The determinantal condition now leads to the quartic 
v (v3 — »2 — 7y — 3) = 0. 


A3,A4. Antisymmetry about G,, symmetry and antisymmetry, 
respectively, about G,. The procedure is the same as in A1 and A2: 
the number of unknowns is reduced to five and three, respectively, 
with the results shown in Table V/7. For the higher modes some un- 
certainty exists in the ordering of the eigenvalues; this can only be 
removed by increasing the accuracy of the calculation. 


B. Hexagonal mesh. The results for several different mesh widths are exhibited 
in Table V/7. It will suffice to describe the beginning of the calculation with 
h=4L, for which the mesh system and the notation a, b, ..., g for the function 
values are indicated in Vig. V/23. Again we postulate the various symmetries, and 
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taking the case of symmetry about G, and G, as an example we have from (2.26) 
the equations 


where y = 3 — $/?A. The values c,d, ..., g cam easily be expressed successively in 
terms of a and b: 


a 
c= 2y— — 2b, 
2 


and the last two homogeneous equations then lead directly to the equation for v: 
(vy + 1) (v3? — 3p? + 5) (v? —4y + 2) = 0. 


A hexagonal mesh can be fitted into the hexagon H in various other ways, 
as indicated in Table V/7. 


Example III. If the membrane of Example II is replaced by a homogeneous 
plate, the differential equation governing the vibrations becomes 


Vtu= hu; 


the simplest associated boundary conditions are u = 0, V2u = 0 at a freely supported 
edge and u=0, Gu/cv=0 ata clamped edge. If all the edges are freely supported, 
the eigenfunctions, or mode forms, are the 
same as for the membrane, for a solution 
vot V2v =— Av with v = 0on the boundary 
satisfies V4v = A2v and also the boundary 
conditions v=V2v=0. For a clamped 
plate, on the other hand, a new calculation 
is required. We have to use mesh points 
outside of the hexagon, and because of 
the clamping, the associated function 
values are related to the interior values in 
symmetrical fashion about the edges, as in 
Example I. With h = 4L,v= 12 — Phi A 
and the function values as in Fig. V/24, 
we have from (2.25) the equations 


pom z(b+e+e bb's Cae), 
= , = 
yb= 3(e+ att) —2b—c—e, Fig. V/24. Notation for a clamped hexagonal plate 


As before, these can be simplified very considerably by postulating the various 
symmetries that can occur. Symmetry about the line G, leads to the values y= 1, 
a2y's5, 2, —4 and antisymmetry to the ellis ie 2m, woe Chenatimmepond in g 
values of AL‘ are 104, 284, 284, 455, 455, 524, 626. 
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§3. The boundary-maximum theorem and the bracketing 
of solutions 
The boundary-maximum theorem for second-order elliptic differential equations 
owes its importance to the fact that for many cases of first and third boundary- 
value problems it provides a basis from which one may be able to obtain in a 
simple manner rigorous error limits for approximate solutions, and hence also 


upper and lower bounds for the exact solution. The simple nature of the calculations 
which are involved is demonstrated by the examples in § 3.4. 


3.1. The general boundary-maximum theorem 


The error estimates of the following sections are based on the bound- 
ary-maximum theorem. This theorem was first established for the 
potential equation but is valid in much more general cases and will 
therefore be presented generally here. 


Consider the second-order linear differential equation 
Llul\=r7 


with ” n 
L[uj =— > Ajptjnp— D> b;u;+ cu, 
fiat c= 


(3.1) 


whose dependent variable u(x,,..., x,) isa function of the » independent 
variables x,,..., x, in a closed region B +J of the n-dimensional space, 
B being an open region and J its set of boundary points. The differential 
expression may be written more simply as 


L[u] = — a;,4;,— 6,4, + cu (3.2) 


if we make use of the summation convention which is customary in 
tensor calculus; in this convention the summation signs are omitted 
and summation from 1 to ” understood over each Latin subscript which 
appears twice in a term. The subscripts attached to a and b serve merely 
to distinguish different functions but those attached to (and v, w, 2 
in the following) denote as in (1.11) the partial derivatives 
Ou eu 
ee,’ ve Ox; Ox, 

We assume here that the given functions a;,,0;,¢, ¥ are continuous in 
B+. 

The differential equation is said to be elliptic when the matrix a, 


gk 
(which can be taken as symmetric: 4;,== 4, ;) 18 positive definite in B +7. 
The theorem applies to elliptic differential equations with c=>0. Let the 
open region B be bounded (and connected) and let its boundary I" form 


a closed, connected, piecewise smooth}, (n — 1)-dimensional hypersurface. 
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The boundary-maximum theorem: I/ a non-constant function 
w(x1,...,%,) with continuous partial derivatives of up to and including 
the second order is such that L[w|S0 in B, where L is the differential 
operator of (3.2) with (a;,) posttive definite and c=0, and if further (this 
condition may be omitted for the case c=0) w is not everywhere negative 
in B+I°, then the maximum value M attained by win B+TI ts assumed 
only on the boundary I. 


Proof (indirect)': We derive a contradiction from the assumption 
that there is a point PF inside B with w(P) =M. Since w is not constant, 
there must be a second point Fin B with w(R) <M. There is a curve C 
joining PB and P, and a positive number o> 0 such that every hyper- 
sphere of radius 9 with a point P on C as centre lies entirely within B. 
The continuity of w implies the existence of a point P, on C such that 
w(P,)=M and w(P)<M for all points P on C lying between P, and P,. 
We now choose a point P, on C lying between P, and P, and sufficiently 
near P, that the hypersphere S, with P, as centre and with BF, on its 
surface lies entirely within B. We therefore have a hypersphere S, with 
w(P,)<M at its centre P, and w(R)=M at a point FB, on its surface. 
We can now shrink this hypersphere until we arrive at a hypersphere S., 
centre P,, with w<M at all points inside S, and with at least one 
point P; on its surface where w(f3)=M. Then the hypersphere S, with 
P, P, as a diameter will have w= at only one point F, on its surface; 
elsewhere on its surface and in its interior w<_M. Let FP, be the centre 
of S, and R its radius. We now define a fourth hypersphere S, with 
centre PB, and radius 9’<R and also so small that S, lies completely 
within B. Then, with the origin of the co-ordinates %,,..., x, trans- 
ferred temporarily to the point B, and with the distance from it denoted 
by 7 (7? =x,x;), positive constants 6 and « can be chosen so that the 
auxiliary function z=w +6(e-*""— e-**’) is less than M everywhere 
on the surface ® of S,; for on the part of ® which lies outside of S, 
the bracketed factor is negative and on the remainder, which is a closed 
set, w<M’<M, so that, for given a, 6 can be chosen so small that 


1 Cf. E. Horr: Elementare Bemerkungen iiber die Lésungen partieller Differen- 
tialgleichungen 2. Ordnung vom elliptischen Typus. S.-B. Preuss. Akad. Wiss., 
Phys.-Math. Kl., pp. 147—152, Berlin 1927. — Courant, R., and D. HILBERT: 
Methoden der mathematischen Physik, Vol. II, p. 275. Berlin 1937. — BaTEMaAN, 
H.: Partial differential equations of mathematical physics, p. 135. New York 
1944. — The theorem can be proved very simply for the special case of the potential 
equation — one way makes use of Poisson’s integral, cf. for example Pu. FRANK 
and R. v. Misgs: Die Differentialgleichungen und Integralgleichungen der Mechanik 
und Physik, 2nd ed., Vol. I, pp. 691—692. Brunswick 1930. “A priori” limits for 
the solutions of boundary-value problems are derived by G. FICHERA: Methods of 
functional linear analysis in mathematical physics. Proc. Internat. Math. Congr. 
Amsterdam 1954. 
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z<M there also. Further, z(R)=M from the definition of z. Con- 
sequently we have a function z which takes the value M at the centre 
of S, and is less than M everywhere on the surface of S,; it must there- 
fore have a relative maximum with z2M for at least one point F, 
inside of S,. 

So far « has been an arbitrary positive number; we now choose it 
so that L[z]<0 at BR. We have 


L[z] = L[w] + 6{L[e—*""] — ce“#®"} 
and 
eu ele ** "| —_ Gens) =——s 4a? a; , x; rags 2a(a;; sty %;) ae ge cetP—RY), 


Here «2 is multiplied by a negative factor and the last term is non- 
positive since c=0; therefore by choosing « large enough we can ensure 
that the expression in curly brackets takes only negative values (exclud- 
ing zero) in the whole of S,. Since L[w]<0, we also have L[zj}<0 
everywhere in S,, in particular at PB. 

Now at PB, z has a relative maximum; at PF, therefore, z,=0 (7) =1, 
.., ”) and the negatives of the second partial derivatives —z;, form a 
positive definite or semi-definite matrix: 


— 5p e E,20 
for arbitrary real numbers é,,..., &,. Consequently 


where both the a,;, and the —z,, are the coefficients of positive (semi-) 


definite quadratic forms, so that 
— 4;,2;,20 


from a result due to FEJER!. This implies immediately that L[z]p 20 
for the case c =O; and since the conditions of the theorem require that 
M=O0 when c=0, we have z(P,)=M=O, and hence L[z]p =0, also for 
the general case c20. Since z was chosen above so that L[z]p<0, 
we have arrived at the desired contradiction. 


Corollary”. The corresponding boundary-minimum theorem, in which 
the inequalities satisfied by L[w| and M are reversed (i.e. have the signs 


1 Fryer, L.: Uber die Eindeutigkeit der Lésung der linearen partiellen Dif- 
ferentialgleichungen zweiter Ordnung. Math. Z. 1, 70—79 (1918). 

* The analogous theorem to the boundary-maximum theorem for the cor- 
responding difference equations has been proved by T. S. Motzki1n and W. Wasow: 
On the approximation of linear elliptic differential equations by difference equations 
with positive coefficients. J. Math. Phys. 31, 253—259 (1953); this result can be 
proved very easily, cf. R. Courant and D. HILBEert: Methoden der mathemati- 
schen Physik, Vol. II, p. 275. 1937. 
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S, = interchanged) and M is the minimum value attained by w, 1s also 
valid (the boundary-maximum theorem has only to be applied to the func- 
tion —w). 

A further consequence of the boundary-maximum theorem is the 
following : 

If two functions w, and w, with continuous partial derivatives of up to 
and including the second order both vanish on the boundary I‘ and are such 
that |L[w,]|SL[w.] in B, then |\w,|<w, in B. 


This can be seen by writing w=w,—w,, w* = — W,— Wy, So that 
L[w]<o0 and L[w*|<0. The maximum of w cannot be negative since 
there are points where w =0 (on the boundary /"); thus w satisfies the 
conditions of the boundary-maximum theorem, and hence M =0 since 

= 0onT'; consequently w <0. Similarly w* <0, and therefore |w,|<w,. 


3.2. General error estimation for the first boundary-value problem 


Consider now the first boundary-value problem associated with the 
equation (3.1), in which w takes prescribed values #@ on the boundary J’: 


u=h onl; (3.3) 


for simplicity we will assume that the given function # is continuous 
on I’. The tilde will be used to denote boundary values for other func- 
tions also; for example, @ will denote the value of v on the boundary. 

Let v be an approximate solution of the boundary-value problem 
which satisfies at least one of the equations (3.1), (3.3). We distinguish 
two cases (cf. Ch. I, § 4.1). 


Case 1. v satisfies the differential equation L[w] =r exactly but need 
not take the prescribed boundary values. The error function w=v—u 
then satisfies the boundary-value problem L[w] =0, ® =0 — %, in which 
the boundary values ® are known for a given approximate solution v. 
Since L[w] =0, w satisfies both of the conditions L[w]<0 and L[w|=20, 
which appear in the boundary-maximum theorem and its corollary, 
respectively. If w20 somewhere in B+, then by the boundary- 
maximum theorem w assumes its maximum value only on the boundary 
and Wmax=Wmax0- Similarly, if w<0 somewhere in B+-J’, then by 
the corollary w assumes its minimum value only on the boundary and 
Wmin= Win 0. Consequently, if w—0O somewhere in B +1", then we 
have min WX Dmax, Where Din SO, WmaxZO. If we O in Biel”, we. 
if w does not change sign in B+ J’ (w being a continuous function), 
then for w>0, say, we have 0<wSW@pyax- 


We can distinguish these various cases according to the behaviour 
of ® instead of w: this is more convenient for application and leads to the 
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Error estimate. For the boundary-value problem (3.1), (3.3) with c20 
and (a;,) positive definite let v be an approximate solution which satisfies 
the differential equation L[u] =r exactly. The boundary values ® =1 —4& 
of the error function w =v —u are determinable. If ® takes the value zero 
somewhere on I’, then 


in B. If ® does not take the value zero somewhere on I’, 1.e. ® 1s everywhere 
positive or everywhere negative on I, then w is everywhere positive or 
everywhere negative, respectively, in B and 


|| S| @|max- (3-5) 
In the case c=0, (3.4) holds independently of the behaviour of w. 


From the point of view of practical analysis the situation described 
here deserves mention as being particularly favourable for error estima- 
tion. Error estimates for other problems involving differential equations 
often turn out to be far more intricate and much less precise than those 
obtained here. If in fact we were specifically aiming to find constant 
error bounds valid over the whole of the region B, we could not do 
better than the estimates (3.4) and (3.5), for the error actually reaches the 
specified limits on the boundary J" and the constants are therefore 
best-possible. 


Case 2. The approximate solution v satisfies the boundary condition 
(3.3) but not necessarily the differential equation (3.1). This situation 
arises, for instance, when Ritz’s method has been used (cf. § 5) and is 
therefore of particular interest. The residual function Liv] —r= 
L{v]—L[u] is now not necessarily zero. We suppose that we can 
construct two auxiliary functions qg, and g, such that 


L[vyj+L[qa]sr and Liv) +L[gq.)=7 (3.6) 


everywhere in B+J°. One way of doing this is to evaluate L[v], then 
choose suitable functions gf and gz, form L(g] and L{g¥] and try to 
find constants c,, c, such that the inequalities are satisfied in B+ by 
hM= 91 and q.=c,g¢. Such functions ¢,, ¢, can always be specified 
when a function z is known with L[z|S —A<O in B; for the Laplace 
expression 
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The boundary values of the functions v + 4,— 4 and v + q,.— 4 are known; 
let M, be the maximum of v +-¢,— 4 and M, the minimum of v +4¢,— 
on the boundary. Now put 


_{%G for the case c=0 
2 eva for the case c=O0, 

_ {My for the case c=0 
oe | min(M,,0) forthe case c20. 


Then, since L[v +4,— 4] S0 and L[v-+q¢,—u]=0 in B+ J, the bound- 
ary-maximum theorem and its corollary yield 


V+QN—USh, VtQ—UZb, 


from which we obtain upper and lower bounds for u: 


V+N—MmMSUSit+ &— Pe (3.7) 


A somewhat simpler estimate can be derived if a function Z can be found 
with 
HA=A>o0 mB, 2Z=—0 on f- (3.8) 
Then with 
e =max |L[v] —7| 
we have 
IL[v — «}| = |L[o] —r| Ses £12] =L|-2-2], 


and by the consequence of the boundary-maximum theorem mentioned 
at the end of § 3.1 


Z 
jv — «| S 4 max |L[v] —7|. (3.9) 


3.3. Error estimation for the third boundary-value problem 


We consider a mixed boundary-value problem in which "is composed 
of two parts J] and J}, but do not exclude the degenerate cases in which 
one part coincides with I’ and the other is null. Let the boundary value 
u =A, be prescribed on J; and let the boundary condition on J} be of 
the form! 

A,u + A,L*[u] = As, (3.10) 


1 Grinscu, H. J.: Eine Fehlerabschatzung bei der 3. Randwertaufgabe der 
Potentialtheorie. Z. Angew. Math. Mech. 32, 279—281 (1952). — See also C. Puccr: 
Maggioriazione della suluzione di un problema al contorno, di tipo misto, relativo 
a una equazione a derivate parzioli, lineare, del secondo ordine. Atti Acad. Naz. 
Lincei, Ser. VIII 13, 360—366 (1953). — Bounds for Solutions of Laplace’s Equa- 
tion Satisfying Mixed Conditions. J. Rational Mech. Anal. 2, 299— 302 (1953). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 26 
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where A, and A,,A,, A, are given functions on J; and J}, respectively, and 
ou 
Wa = 
tay ieee 


as defined in Ch.I, §3.3, with A>0O and o denoting the conormal; 


further let A 
Be Hea ols A 
A, 


The other assumptions made in Ch. I, § 3.3 for the formulation of the 
third boundary-value problem are also made here. 

Now let v be an approximate solution which satisfies the differential 
equation (3.1) exactly but the boundary conditions only approximately: 


p=AzZ “on ra 


Av+A,4 2 = AS on ly. Ben) 

We now define a boundary function y along the whole of the boundary 
I’ as the defect in the satisfaction of the boundary conditions, with the 
mixed condition normalized so that the coefficient of u is unity. Thus 
the error function w=v — u, which satisfies the homogeneous differential 
equation corresponding to (3.1): 


Ele | —0; 
is subject to the boundary conditions 


w=AT—A,=y on fi, 


A,A dw _ A¥—A, _ (3.12) 
ver A, 06 ay Vee: 


Again w satisfies both of the conditions L[w]<0 and L[w]=0 of 
§ 3.1 since L[w] =0. If w2=0 somewhere in B+ [+ 13, then by the 
boundary-maximum theorem w assumes its non-negative maximum 
value M only on the boundary J’= J{+ J}, say at a point Q. 

If Q is on J, then w(Q) =y(Q) =M, and consequently M<y,,,,, 
where ymax denotes the maximum value of y on J’; if Q is on J}, then 
w(Q)Sy(Q), for the maximum property of w(Q) ~ Af implies that 

EO 
Co 
at Q (it was shown in Ch. I, § 3.3 that for an elliptic differential equation 


the conormal points into the interior): in both cases w<ynax- 


Similarly, if w<0 somewhere in B+T, then w2ymin. In the case 
where the coefficient c in the differential equation (3.1) is zero these 
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inequalities hold irrespective of the behaviour of w. Summarizing we 
have the 


Error estimate. For the (mixed) boundary-value problem (3.4), (3.10) 
with c= 0, (a;,) positive definite and 20) let v be an approximate solution 
which satisfies the differential equation. The boundary function y associated 


with the error function w =v —u can then be determined from (3.12). If y 
takes both positive and negative values, or if y takes the value zero, then 


Minin == Os Vinay (3.13) 


in B. If y has a fixed sign, then w has the same fixed sign and 


|~| Ss le (3.14) 


in B. For the case c=0, (3.13) holds independently of whether the sign 
of y varies or not. 


3.4. Examples 


It is often essential to know particular solutions of the differential equation 
if an error estimate is to be readily worked out. The derivation of particular 
solutions usually presents no difficulty when the differential equation is separable, 
i.e. when solutions in Bernoulli product form can be obtained by solving ordinary 
differential equations [error estimation and the derivation of particular solutions 
are treated in more detail in an example given by the author in Z. Angew. Math. 
Mech. 32, 207 (1952)]. There are also methods of obtaining particular solutions in 
general cases}. 

I. The torsion problem for a beam of square cross-section (with sides 


of length 2) leads to the boundary-value problem 


vee — O01 2, emcon. = (| ssl: |9)| 254, 


u=—x?+y2%on TI, ie. for |x| =1 and for |y| =1. 
Let us assume for v an expression of the form 


V = Ay + 4% + 4g0p, 
where 
vy, = x4 — 6x8 y? + yt=re(x +7y)', 
= e282 y* + 70x yt — 28 x? y8 + y= re(x +7y)% 


It is expedient to make fairly accurate sketches of the behaviour on 
the boundary of the functions v1, V2, %, and also of several approximate 
solutions v — here, on account of symmetry, we need only consider the 


1 BERGMAN, ST.: Operatorenmethoden in der Gasdynamik. Z. Angew. Math. 
Mech. 32, 33—45 (1952). 
26* 
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u=t€ line y =1 (cf. Fig. V/25, in which & = x2); 

2 then it is easy! to see how v can be ad- 
justed by the addition of cv, or Cevs, 

7 respectively, so as to approximate “ more 


Z eye closely (aiming at a minimum maximum- 


1 Us error) and to see what would be suitable 
0 7 € values for c,,c,. Each adjustment is 
followed up numerically with the aid, say, 
: of a table of function values at equidistant 
’, points, in which can be included a simple 
1 row-sum check as in Table V/8. If only 
0 a ay and a,v, are used, we obtain 
l, G1 = 1-175 — 0-20, (x, y), 
a and for the error along y =1 we have 
I | 1-475 — 0-20, — (x* + 1)| < 0-025; 


then from the error estimate of § 3.2, 
Case I 
|~ — g| S 0-025 


0 7é 
ars : ; 
holds in B also. If v, is used as well, we 
Q75 Te obtain 
Qt6. 


P2 = 1:1786 — 0-20, + 0-006 V, + 0-001972,, 


Vy 
where ,=v,+30,, with | g,—|< 0-005 
0.780 on the boundary, and hence |y,—«| <0-005 
0175 ia also in B; in particular, we obtain the 
limits 


Fig. V/25. Error estimation by means of 
the boundary-maximum theorem 44 736 = u (0, 0) Ss 1-4 836 


Table V/8. Tabulay values of various approximating profiles 


=O | €mO2 | Em O3 | Smog | Em or | Emo8 | Sat 
| | check 


= 1+€ (with =x) 1 493 4°5 47 1 2 10°5 
u=1-6é+é8 1 —0:16 —0-74 —1:75 —2-71 —3-46 — 4 —11+49 
U,= 1 —286+ 706*— 2869+ £4 4 —2:0224 |—1-8479 1-062 5 63361 94736 16 30-0019 
Vi=4+0-20,—1 0:2 0468 0-158 0-450 0-168 0:168 0-2 1-202 
Vie=y+3%, 4 —2:5024 |—3-9779 |—41875 |—1°7939 |—0-0064 4 — 44681 
V,= V;— 0-006 V, 0-176 0-18301 | 0:48187 | 0475125) 0:16876| 0-46804 0°176 1-22881 
V,= V,— 000199, 0-4741 0183 31 018322 | 0:47845 OT 304 O17404 | 0:1836 1-25063 


1 A fairly experienced computer will usually achieve the desired result very 
quickly in this way; an automatic procedure could be used, of course, and the a, 
determined by TREFF1Tz’s method (cf. § 6 — the present example is in fact treated 
by this method in §6.5) or one of the error distribution principles, but much 
more computation would be involved. 
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for the value at the centre of the square (the error in the mean value 
1-1786 is less than $%). 


II. For the heat conduction problem (cf. § 4.2) 
V24=—1in B, ie. for |x|<14, |y| <1 
Ou : 
u=>Z, onl, ie. for |x| =4 and for |y| =1, 
we use an approximate solution of the form 


J 
4 


v= — + Ag + 4,0, + agt, 
with the same v, and v, as in the last example. 
Then on y=1 we have (with & = x?) 
a dv esr s 
y= (v + Fey + a+ 4V,+ agh,, 
where 


Yi=5—186 +8, Va=9 — 1968 + 350% — 846° +- 4. 


As in the previous example, we try to choose dg, a, a, so as to make 
the absolute value of the error | y| as small as possible. As in Example I, 
the following results were obtained with the aid of graphs and tabulated 
values of the various functions involved. 


With a,=0, i.e. using v, only, we obtain 


| mA i + 0-8217 — 0-0147V,| <0-0019, 


while if we include v,, we effectively gain another figure: 


| = at + 0-821 66 — 0-014436V, + 0-000063 1 ¥, | < 0-00019. 


According to (3.13) we obtain from this last result the error estimate 
| 2 eee +. 0-821 66 — 0-014.436v, + 0-:000063 11, — u | < 0.00019, 


which is valid in the whole of B+J°; in particular, we have the useful 
limits 

0-821 47 S “(0, 0) S 0-82185, 

0-55710S (0, 1) S 0-55748, 


0-38022 < “(1, 1) < 0-38060. 
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3.5. Upper and lower bounds for solutions of the biharmonic equation 


Here we describe briefly, making use of the definitions and results alreadv 
given in Ch. I, § 3.3, a fundamental way! of deriving limits for the solution u of 
the “‘clamped plate problem”’ 


VY4u=pin B, 
=f, Uy e om If 


with region B, boundary [' and inward normal » as in Ch.I, §§ 3.2, 3.5. The 
existence of a solution to such a boundary-value problem will be assumed. 


Then the problem 
Vtu*®*—=0 im B, 
u*=—o, uy=—o,onl 
will also possess a solution “*; here we select an arbitrary interior point (%9, 3‘) 


of B and take g to be the “fundamental solution’ which is singular at (%p, ¥) 
as defined in Ch. I (3.40). According to Ch. I (3.41) we have 


82Uu(%, Yo) = A+ J, 


A= IfoViudxdy + f(u,V%9 — u(V%0),] ds 
B if 


where 


is known but 


h= f lo(V2u), — 0,V2u] ds (3.45) 
i 


is not (at least, not until the problem has been solved). 
Now let v, w, v*, w* be functions satisfying 


Viuv=p, V4v*¥—0 in B, | 
w=f, W= 8, wt = — Q, wt = —o,onl. 


Then from Ch. I (3.36), (3.39) we have 


(3.16) 


(D[u — w, u* — w*))?S D[u — w] D[u* — w*] S D[v — w] D[v* — w*}, 


1 Diaz, J. B., and H. J. GREENBERG: Upper and lower bounds for the solution 
of the first biharmonic boundary-value problem. J. Math. Phys. 27, 193—201 
(1948). Another way, which is based almost entirely on mechanical concepts, 
is described by P. Funk and E. Brrcer: Eingrenzung fiir die gréBte Durchbiegung 
einer gleichmaBig belasteten quadratischen Platte. Federhofer-Girkmann Fest- 
schrift 1952, pp. 199—204. — Limits for further problems from the theory of elasti- 
city, including limits for the derivatives of the solution, are given by J. L. SyncE: 
Upper and lower bounds for the solutions of problems of elasticity. Proc. Roy. 
Irish Acad., Sect. A 53, 41—46 (1950). — Pointwise bounds for the solution of 
certain boundary value problems. Proc. Roy. Soc. Lond., Ser. A 208, 170—175 
(1951). — Mapte, C. G.: The Dirichlet Problem: Bounds at a point for the Solution 
and its Derivatives. Quart. Appl. Math. 8, 213—228 (1950). — CoopERMAN, PH.: 
An extension of the method of Trefftz for finding local bounds on the solutions 
of boundary value problems and on their derivatives. Quart. Appl. Math. 10, 
359—373 (1953). — Nicorovius, R.: Abschatzung der Lésung der ersten Platten- 
Randwertaufgabe nach der Methode von Maple-Synge. Z. Angew. Math. Mech. 
37, 344— 349 (1957). 
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where D is the integral operator defined in Ch. I (3.34). Now the function appearing 
to the second power on the left-hand side can be expressed in terms of u(%9, ¥o) 
and known functions. We have 


D{u — w, u* — w*) = D[w, w*) — D[u, w*) + Diu — w, u*], 


in which the last two terms can be evaluated by the formula (3.37) of Ch. 1; with 
p=u*, p=—u—w we see that 

D{u — w, u*] =0 
and with p=, y= w* that 


Du, w*] = ff w*Viudxdy — f.. 
B 


Substituting for J, from the expression for 82u(%, yo) [Ch. I (3.41)] we obtain 


D{u — w, u* — w*] = D[w, wt] — ff w* Viudxdy + 82 (x, Y) — Ae 
B 
With 
W=ftffwtViudsdy — D[w, w*] 
B 


we therefore have the estimate 
(82 u(%», Yo) — W)?S D[v — w] D[v* — w*]. (3.17) 


To use this estimate, we have to find four functions v, w, v*, w* satisfying (3.15). 
A suitable function for w* is probably the most difficult to find. D1az and GREEN- 
BERG recommend that outside of a small circle C, centre (%, Yo), w* be chosen 
as —g, and inside of C as a polynomial in y such that w* possesses continuous 
second derivatives everywhere, including on C. 

Another fundamental approach has been demonstrated by Mrranpal. If the 
boundary (possibly consisting of several separate curves) possesses a continuously 


turning tangent, and if the boundary functions /, g and also f’= at (s denoting 
s 

the arc length along the boundary) are continuous, then the following estimates 

hold for the homogeneous equation (p = 0): 


Yee + 8 <Q = Ky[max|e| + max|f']] + Ka max fl, 
|u(P)| S6Q + max| fl, 


in which P is an interior point of B, 6 is the distance of P from the boundary if 
and K,, K, are constants depending only on the geometry of the region B; the 
calculation of numerical values for these constants is rather laborious. This yields 
a fundamental error estimate for an approximate solution of the clamped plate 
problem which satisfies the differential equation exactly. 


§ 4. Some general methods 


Various general methods have already been discussed in Ch. I, §§ 4 and 5; it 
suffices here to refer to these methods and give examples. More general boundary- 
value problems for partial differential equations were formulated in Clos Ilo) ilnale 


1 Miranpa, C.: Formule di maggiorazione e teorema di esistenza per le funzioni 
biarmoniche di due variabili. Giorn. Mat. Battaglini 78, 97—118 (1948/49). 


{ 
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4.1. Boundary-value problems of monotonic type for partial 
differential equations of the second and fourth orders 


As in the case of ordinary differential equations, problems of 
monotonic type can be treated effectively by making use of their 
monotonic property. Let the differential equation read 


T[u] = L[u] + F(x;,u) =0, (4.1) 


as in Ch. I (5.52). We consider first equations of the second order and 
focus attention on those equations for which L[u] has the form (3.2) 
with coefficients satisfying the conditions laid down in § 3.1. Let the 
boundary condition be 


either (case I) “=y onl (4.2) 
or (case II) A,u+A,L*[u] = A, on I, (4.3) 


where y, A,, Ag, Ag are continuous functions of position on I" with 
a <0, and J* has the same significance as in Ch. I, § 3.3. We can then 
me the following 


Theorem. I7 the function F(x;, u) in the differential equation (4.1) is 
such that OF /0u exists and is non-negative in a domain H of the(x,,...,%,,#) 
space which is convex with respect to u, then the boundary-value problems 
(4.1), (4.2) and (4.1), (4.3) with the differential expression L[u] of (3.2) 
[satisfying the conditions of § 3.1] and the boundary conditions (4.2) = 
(4.3), respectively, [satisfying the above assumptions] are of monotonic 
type. This implies that if a solution u exists and lies in H, then it is 
bracketed by any two functions u, and uy which satisfy the boundary condi- 
tions and are such that T[u,|SOST[u,]: 


mSusu, in B. (4.4) 


The theorem still holds when, as in § 3.3, (4.2) is prescribed on a part 
I, of the boundary I’ and (4.3) is prescribed on the remaining part Ij. 


To prove the theorem we have only to show (see Ch. I, § 5.6) that 
Lfe] + eA(x;) 20 in B, 


where A(x;)20, together with the appropriate homogeneous boundary 
condition (case I: e=0 on I’, case II: Aye +.43L*{e] =0), implies that 
€20. For this we use the boundary-maximum theorem of § 3.1. 
Suppose that the minimum value of « is negative and let x ;=6§; be 
a point at which this minimum value is attained. 
ile Ibi é, is an interior point of B, then since «¢ is continuous, there 
must be a neighbourhood of é; in which ¢<0; in this neighbourhood we 
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therefore have L[e]=0. But according to the boundary-maximum 
theorem this means that there cannot be a negative minimum value 
in the interior. Consequently €; cannot be an interior point of B. 

2. Neither can it be a boundary point; for in case I ¢=0 on the 
boundary and in case II a negative minimum on the boundary leads 


to a contradiction as follows. At é; on I’ we must have = =O0, for o, 
oO 


being in the direction of the conormal, points inwards (for elliptic 
equations). Therefore a L*[e]<0 at &,, which, since we have assumed 


that ¢(&;) <0, is incompatible with the boundary conditions. 

Thus we must have ¢=0 and the theorem is proved. It is applied 
to a numerical example in § 4.3. 

The monotonic character of some fourth-order boundary-value prob- 
lems can be demonstrated by means of this theorem. Consider, for 
example, the following simple problem which arises in the standard 
treatment of the flexure of a freely supported flat plate: 


a a of 
Ve = or + ope +o 77) in B, (4.5) 
u=(s), Vie =ya(s) on LY, (4.6) 


where s is the arc length along the boundary curve I’ of a simply- 
connected plane region B and 7,, y2 are given functions. Here we 
define the operator T by 

Tv = Viv — r(x, ¥) 


and restrict its domain of operation to those functions v in B which 
possess fourth-order partial derivatives and satisfy the boundary con- 
ditions. This operator also is monotonic, for it can be readily shown that 


Yie>oin B and V*e=e=00n T 


implies 20: we put —P%e=, so that —V?(20 in B, €=0 on i; 
then, according to the above theorem, ¢>0 and consequently —V?e20 
in B, e=0 on I’; using the above theorem again we have «20. 
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For these methods (see Ch. I, § 4) we use as an approximation to 
the required solution “(x;,..-, %,) some function w(%, ---, Xa» A» +--+» %) 
which depends on ~ parameters 4, and which, for arbitrary values of 
these parameters, satisfies either the differential equation or the boundary 
conditions, whichever is the more convenient. Insertion of w into the 
boundary conditions or the differential equation, respectively, yields 
residual error functions ¢(%;, 4,), and by choosing the a, suitably we 
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make these error functions approximate the zero function as closely as 
possible in the sense of one of the principles mentioned in Ch. I, § 4. 
We recall that methods of this sort may be conveniently classified into 
boundary, interior and mixed methods, as in Ch. I, § 4.1. For several 
important classes of boundary-value problems we have means for 
deriving bounds for the error of an approximation function in a quite 
simple manner, cf. §3 and § 4.1; it is therefore very useful to possess 
in the procedures based on the error distribution principles methods of 
a parallel simplicity for the calculation of approximation functions. 


Example. Consider the problem 


Cu eu : : 2 
2 —, = — 
a oan + 338 = 4 in the interior of B, 
—— a on the boundary of B, 


where B is the square |x|<1, |y| <1 (Fig. V/26) and » is in the direction 
of the inward normal; w could be interpreted physically as the tem- 
perature distribution (measured as the excess 
over the temperature of the surroundings) 
in the cross-section of a square wire carrying 
a current and for which the amount of heat 
lost to the surroundings is proportional to the 
excess temperature at the surface. 


For our approximation function we can 
assume an expression [Ch.I (4.10)] which 
satisfies either the differential equation or 
Fig. V/26. Boundary and inward the boundary conditions. One way of obtain- 
normals ft de pabien “ing an expression which satisfies the boundary 

conditions is to write down a polynomial 
expression satisfying any symmetry conditions that exist but whose 
coefficients a,, are otherwise arbitrary: 


W = Ag + Agg (x? + Y?) + dag X? V? + agg (at + V4) + ayy (vty? + x2 49) + ---, 


and then determine these coefficients from the boundary conditions (cf. 
§ 4.3). In this way we obtain, for example, 


W = AV + AgVy = a, (9 — 3 (x? + y*) 4+ x2 y2] + 


+ 4g[30 — 5 (x? + y) — 3 (x4 + y4) + ayaa y9)). ” 


For an expression which satisfies the differential equation we require a 
particular solution, together with a series of functions satisfying the 
homogeneous equation (and also any symmetries which exist). In our 
present case the latter can be obtained, for example, as the real parts 
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of the functions (x -+7y)*2; then with —4(«?+ y?) satisfying the in- 
homogeneous equation we have 
w = — 4 (x2 + 9") + ag + a (x4 — 6x? 9 + yA) + (4.8) 
+ ay (x8 — 28 x8 y* + 70x4 yt — 28 x2 y6 + 48). 
We now illustrate several methods for determining the a,. 


I. Collocation!. A. We use first the expression (4.7) to illustrate 
collocation as an ‘‘interior’’ method. Substitution in the differential 
expression yields 

V2w = ay[—12 + 2(x2 + 9°)] + 
+ ag[— 20 — 36(x?-+ y?) + 2(x4-+ 94) + 242797), 


which is to be put equal to —1 at the collocation points. 


| (4.9) 


The choice of collocation points is a matter of some uncertainty; 
although normally some attempt at a uniform distribution would be 
made, we have a virtually unrestricted choice, but no reliable guide to 
the effect this choice has on the results. In the case of a single-term 
expression (only a,+-0) the coefficient a, is given by 


A 
a= — 
1°” 2(6— #— 9?) 


for an arbitrary position (x, y) of the single collocation point, and will 
vary between 7» (for x= y =0) and } (for x =y =1) as the collocation 
point moves about the square; thus we can obtain values for w(0, 0) 
lying anywhere in the range from 0-75 to 4-125, which is a rather large 
variation. 

For a two-term expression with a, and a, we have to dispose two collocation 
points. On account of the symmetries which exist, collocation actually occurs in 
general at sixteen points; we try to choose the two arbitrary points so that the 
full set of sixteen collocation points are distributed as uniformly as possible. If, 
for example, we choose the points *= 4, y= and *=1, y= $, we obtain the 


two equations 


94 3935 _ 19 455 
agg ey: 


which yield the values 


446 32 
= —__—_ = 0° = ——— = 0-005 283. 
ay 6057 0:07363, 4 6087 5 
4974 
For «(0, 0) these give the approximate value w(0, 0) = yi) = 0:821 20. 


Table V/9 exhibits the results for various positions of the collocation 


1 See also R. A. FRAZER, W. P. Jones and Syivia W. SKan: Approximations 
to functions and to the solutions of differential equations. Rep. and Mem. No. 1799 
(2913), Aero. Res. Comm. 1937, 33 pp. 
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Table V/9. Collocation for the temperature distribution in a Square wire carrying a 


Co-ordinates 
Expression 


current 


| Position 


of the collocation points 


Results 


t if 
only a, A Ve 9 
w (0, 0) = = =0-8182 
a7 
2 92 
only a, as dil 
os 
an —SS= 
Oo < 
o~ ee: 
Enos 3 1 43 
es only a, oa vi 36 
a. 
— & 
H 
2 ina 
c rot, yat | 2 =007400 
with 2’ 4 | @,==0-005 148 
a, ag = 8) iee,! 
#=5, Y= w (0, 0) = °° =0-82043 
I 
pe, ae | @,=0-073634 
with 2’ “ @, = 0-005 283 
ay, ay i 1 
e=1, yas w (0, 0) = 22 = 0-821 20 
es 
onlydg | *=1, y=-— | (16 
a w (0, 0) = ay= 0°8125 
as ee 
ot = __ 14615 
og #=1, yu | Sr s2 
sm with 4 
a = 0°821 4314 
ae ees 
‘ 4 =— ——_ = — 0 
oe | igo = — 0'01439 
rt i) re ee 
5 eae _ ink =w/(0, 0) = 2846 
Q po ML | Ji= eS 4 ~~ 15635. 
with ire ig is = 0-821 618 
Ay, A, ay , : 0:01440 
a, =—0: 
*=1 y=1 ‘ 
@, = 0:000064 
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B. Greater convenience and less uncertainty are afforded by the use 
of the other expression (4.8), which satisfies the differential equation. 
This is because the collocation points now lie only on the boundary and 
it is much easier to ensure some degree of uniformity in their distribution. 


On account of symmetry we need only consider the part of the bound- 


ow ow 
ary = —_ = — ——; 
along «=1, where ae ae have 


(w+ 32) =-25* 4+ 


+ ay + a,(5 — 18 y? + y4) + ag(9 — 196 y? + 35094 — 844% + 99), 


which in accordance with the boundary conditions is to approximate 
the zero function as closely as possible. 

First of all, let us put a; =a,=0; then for a general boundary colloca- 
tion point (1, y) 
okey 


er 


Now |y| lies between 0 and 1, so a) can vary from 0-75 to 1; for y=4 
we have 4,=w (0, 0) =0-8125. 


If we include the term in a,, we can demand that the boundary 
condition be satisfied at y—+4 and y=, for example; then from 


993 _ 49 Biases 
ot ilggge = Ga 40 Cin 5K6 ee 


we obtain 
ay = w(0, 0) = 0-821 43, 
a, = — 0:01439. 


The results for a three-parameter expression are also given in 
Table V/9. 


II. GALERKIN’s method. We use the same example to illustrate 
GALERKIN’S method as an interior method; thus we take the expression 
W =A,0,+ ay, of (4.7) as an approximation function. Here we determine 
a, and a, from the equations [see Ch. I (4.13) ] 


Ih (V2?w +1)dxdy=0 (o=34,2), (4.10) 


where V?w is given by (4.9). The evaluation of the integrals leads to 
the equations 


6 6782 4 6782 74144 = 2 
Lh 2 (eee a — — 
5 A 1575 9” 1575 oes 4725. "= S 
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The first approximation (a,=0) can be found from the first equation 
by putting a4,=0: 
5 5 
= = w => = 0-83}3.... 
a=, (0,0) =2 =0-833 


If a, is taken into account, we obtain 


_ 39305 
536397 


i = 0-0732760, a, =0-0053831,  w(0,0) =0-820978. 
4.3. The least-squares method as an interior and a boundary method 


After the general description in Ch. I, § 4.2 we restrict ourselves here 
to just two examples. 


I. Interior method. Let us consider again the example of § 4.2: 


V2u = —41 in the interior 
of the square |x| <1, Sila tell 
a 4) on the boundary q | E ly | ( 


We start with the simplest case of a one-parameter approximation. 
We need a function (x, y) which satisfies the boundary conditions. 
Taking into account the symmetries of the problem, we put 

P = Cy + Cy (x? + y?) + Cy x? y?; 
then on the part of the boundary x =1, |v|<4, for example, we have 


Op op _ 
ov Ox 


2e,% -+- 2e2y", 


and the boundary condition yields 


7) 
(y — eae = + 3€g+ (2+ 3¢) y? = 0; 
consequently 


Cg = — 3Cg, Cy = — 36g = 96, 
and we take 


p = a(9 — 3(xt+ 9%) + 2292). 
Then 


V2g =a(— 12+ 2(x2 +9), 


and inserting this in the expression to be minimized according to the 
minimum principle of Ch. I (4.5), namely 


Jigl =Sf (Vp +1)dxdy, (4.12) 
B 
and evaluating the integral, we obtain 


J=4(1—as 112 x * a’). 
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The condition 


ee 
ca —S +224 x 2 a=0 
yields a= aaa and hence the approximate solution 
P = (9-3 (+9) Vee a 


This gives the following values at the key points of the cross-section: 
¢ (0, 0) = <> = 0-8385 (error + 2:1%), 


a= 05590 (error + 0-3%), 
p(i,1) = = 03727 (error — 14%). 
Proceeding to the second approximation, we put 
P= Cyt Cy (42+ y?) + gx? y? + cy (x8 + Ys) + 05 (a? y* + x4 y?). 


With the relations between the c; required by the boundary conditions the expres- 
sion takes the form 


Pp = 9a+(—3a + 15f) (x2 + y?) + (a — 108) x2 y2— 9B (x4 + y4) + 3B (x? 94 + aty?); 


this function satisfies the boundary conditions for arbitrary values of « and B 
and therefore provides a two-parameter approximation function. With 2«=a,=a, 
2p = a,=b it yields 
V29+1=1+a4,+4+ dAzg, 
where 
A,y= —64+ 22+ y%, A,=30— 64(27+ y?) + 3 (a4 + v4) + 3647 y? 


From the conditions @//@a;=0 (for i=1, 2) we obtain the equations 


ffAdzdy+affAtdxdy+bffA,A,dxdy =o, 
B B B 


ffA,dxdy+ aff A,A,dxdy +b ff Afdxdy =o, 
B B B 


where 
16 112 
mo= ff Adedy=—4x =. tgo= [ff Ardxdy=—4x——, 
B B 

1288 9776 

ate) | adn Ge a= || A Anim ore 
788192 

~ 2 i puC Ue 
Cigar? 4 ane 


We can check the calculation of these integrals by evaluating J[q] for a= a: 
we have 


V2m + 1 = 25 — 63(x2+ y*) + 36.4297 + 3(x4 + 9") 
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and hence 
99143 | 
7S” 


ff (2p + 1)*dxdy =4 x 
B 
this value should be equal to 
Sf (Ger aac A,)*dxdy = 4+ 2019 + 2hqq + Hy + 29+ Mee. 
B 


The equations 
Oy + %y 14+ %2b=0, 
Ogg + 214 + tab = 0 
read 


ves 9776 
a aI 


_ 112 i ibis 788192 
315 1575 


b=0, 


— 210 + 1127a + 12226=0, 


— 735 + 3055a + 49262b = 0, 
and yield 
I 2 FY 
A 719257 
175 593 
=a Fignay 1 aaa Ona: 
The approximate values at the key points of the cross-section are now 
7 (0,0) = $a = 0820909 (error — 0:08%), 
@ (0, 1) = 3(a+ b) = 0-558094 (error + 0°16%), 
(4,1) = 24+ 4b = 0:379277 (error — 0:19%). 

Upper and lower bounds for the solution. It may be mentioned here 
that for this problem upper and lower bounds for the solution, though 
admittedly fairly coarse, can be obtained very simply by direct use of 
its monotonic property — which is assured by the theorem of § 4.1. 
If a function ¢ satisfying the boundary conditions is such that /2¢+4<0 
or 20 throughout the whole region, then g is respectively an upper or 
lower bound for the solution «; thus, for instance, in the approximation 
function which we have just been using we want to choose the constants 
a,b so that V?m+41 does not change sign (naturally we will also try 
to keep its magnitude as small as possible). First of all we construct 
a linear combination of the functions A, and A, which is as near constant 
as possible. It can be seen by evaluating these functions at the ‘‘key”’ 
points that the best combination (up to a constant factor) is 43.4,+4,; 
we have 

— 2468S 43A,+ A,S — 228 
and hence 


soy (43-41 + A) +1505 —* (43.4, 4 Ay) +4. 
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Consequently y is an upper bound for « when « = =. = we and a 
lower bound when « = a p= a . The mean of these two bounds 


gives an approximation with known error limits; at the centre of the 
square, for example, we have 4(0, 0) =0-8177 +0-0311. 
II. Boundary method. We choose a different problem here, namely 
Viu=x*—1, «=0 for |x| =1 and for |y| =4; 
“ can be interpreted as the transverse displacement of a membrane 


stretched over a rectangular frame and distorted by a non-uniformly 
distributed transverse load. 


Table V/10. Values of the individual contributions ay» 


a= ee | ae ag9 = Pp 

00 — 2 160 ~— 6 20 10 30 44 40 18 
7 1 41 13 : 

i= 3q |= % | = G20 | = Ges | 72 
47 

402 = 460 


b 
The function gp =w,)+ >) 4,w, with 
y=1 


AE os 

2 

satisfies the differential equation exactly for arbitrary a, and exhibits 
the symmetries possessed by the problem. We restrict attention to the 


first quadrant and denote 
4 i 
fFU,y)dy+fF(x,t)dx by [ Fas. 
0 0 c 


Then the least-squares requirement reads 
I[y] = f g? ds = minimum, (4.13) 
r 


, w,=re(x +t)?” 


or 


ae ome 
Degg = pms (y Ny Zisnes Phe (4.14) 


To expedite the derivation of the equations for the a, from (4.14), 
we construct a table of values of the quantities 
ee ce a 
ra 
Table V/10 gives sufficient values for the case p = 2, for which we obtain 
the equations 


13 43 13 83 __—ss-.2435 
, = a eee 
a 24 420’ a 160 2% 120 84 


Collatz, Numerical treatment, 3rd edit., 2nd print. 27 
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with the solution 


16643 848 
1° 60 X 2443 


=0-1135, a= = 0-3471. 


2443 
The boundary values of 
the corresponding ap- 

y-oo% proximation pare shown 

graphically in Fig. V/27; 

because of the zero 

boundary condition this 
graph represents the 
error distribution on the 


7 i 7 5 
reat 2-0 asl Yat _Y-0 Weg boundary. Since u —;-x4 
LS a : : 
y-F z=1 +4x? is a harmonic 
Fig. V/27. The error distribution on the boundary function, we infer from 


the boundary-maximum 
theorem of §3.1 that the maximum absolute error in g on the 
boundary, about 0-044, is not exceeded in the interior: |p —u|<0-044 
in the whole rectangle. 


4.4. Series solutions 


A method which is often used for the solution of boundary-value 
problems is to find a series expansion for the solution « of the form 


fo 0] Cc 
u= day, E,, Say,Oor u= ah Ce ae (4.15) 
m=1 m,n=1 
where WY, or W%,,, are chosen as known functions of the independent 
variables and the a,, or a,,,,, respectively, are constants to be determined. 
Naturally triple sums and higher multiple sums can also be used as 
occasion demands. 


What was said in Ch. III, § 7.1 concerning series solutions for ordinary 
differential equations is obviously also valid here; for partial differential 
equations the effectiveness of a series solution depends to a particularly 
large extent on a propitious choice of the functions ¥ and on what is 
involved in carrying out the method. 


Ordinarily we choose the functions Y so that they satisfy either 


(i) the differential equation, 
or (ii) the boundary conditions, 
or (ili) at least some of the boundary conditions, 


then seek to determine the expansion coefficients a,, (or a,,,) so that the 
series satisfies the differential equation or the boundary conditions when 
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inserted. This usually leads to an infinite system of equations for 
infinitely many unknowns a,,; such a system is normally solved in an 
approximate manner by putting all the unknowns after the first N 
equal to zero and determining the remaining unknowns from the first 
N equations. A thorough treatment of the subject of series solutions 
would have to cover such a wide range of phenomena that we content 
ourselves here with a few examples which demonstrate the procedure 
involved in the application of the method; for the rest, reference can 
be made to the literature, where numerous examples? of series expansions 
are to be found?. 


4.5. Examples of the use of power series and related series 
I. For the heat conduction problem (cf. § 4.2) 


(v = inward normal), 


16 
éu/dv =u on the boundary (4.16) 


which has already been treated by many different methods, the power 
series method is superior to all others in shortness and accuracy. We 
make use of the symmetries of the problem and instead of the general 
double series 


1 For instance, in A. SOMMERFELD: Partielle Differentialgleichungen der Physik. 
Leipzig 1947. — Frank, Pu., and R. v. Mises: Differential- und Integralgleichungen 
der Mechanik und Physik. Brunswick 1930 and 1935. See also our Ch. IV, intro 
duction and § 4.3. 

2 A method for the solution of boundary-value problems based on the Bergman 
“kernel function’’ associated with the given region and the given differential 
equation is given by ST. BERGMAN: Kernel functions and conformal mapping. 
Surveys of the Amer. Math. Soc. 5 (1950); see also ST. BERGMAN and M. SCHIFFER: 
Kernel functions and elliptic differential equations in mathematical physics, 
Part B. New York: Academic Press Inc. 1953. The kernel ranction can be obtained 
by expansion in terms of the functions of a complete orthonormal system. For the 
potential equation in a simply-connected region of the complex z plane, for example 
the system of polynomials obtained from the powers of z by orthogonalization with 
respect to the given region is suitable. The kernel function is defined as the dif- 
ference between the corresponding Green and Neumann functions. There are 
simple rules for modifying the kernel function when the differential equation or 
the region is altered. This method has been used at the National Bureau of Stand- 
ards, Washington, to solve boundary-value problems for the potential equation 
in doubly-connected regions bounded by concentric rectangles. Experience must 
show whether it is best to work in terms of orthonormal systems or to tabulate 
the kernel function for several different regions and a given differential equation, 
say the potential equation. 

Dif 
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use the simple series 


co 
“= — F(x? + y%) + 2 a0 re(x +7y)*e 
= 
= 2 yaya Catyes yao 
+ a4 (x8 — 28 x8 y? + 70 x4 y4 — 28 x2 y8 + ys) + 
+ Ag (x1? — 66x19 y? + 495 x8y4 — 924x848 +...) +... 
The first term — }(x?+ y?) satisfies the inhomogeneous potential equa- 
tion and the subsequent terms, being the real parts of analytic functions, 
satisfy the homogeneous equation; therefore 72% = — 1 for arbitrary Aig 
Only powers (x +7¥)*¢ which satisfy all the symmetries of the problem 


have been used. The a, will now be determined so that the boundary 
condition 0u/0v =u is satisfied. We form 


(#)za1= 4 — 2(1 + 9?) + a9 (1 — Oy? + 4) + 
+ a4(1 — 28y? + 7094 — 28 y* + 8) + 
+ ag(1 — 66? + 495 yt — 924y64----) 4 .--, 
($<) = — 4+ a5 (4 — 129%) + a,(8 — 1682 + 280y4 — 5648) + 


| + ag(12 — 66052 + 39604 — 5544984...) +... 


The sum of these two expressions is to vanish identically, so the coefficient 
multiplying each power y** in the sum must be put equal to zero; 
this yields the following infinite system of equations for the unknowns fs: 


Ag t+5a,+ 9a,t+ 13ag+-:-= 2 (coefficient of y°), 
184,+196a,+ 726a,+---=—2 (_,, » ), 

A, + 350a,+4455ag+---= O ( o> a, 
84a,+ 6468a,+---= 0 ( : Or a 


We solve these equations approximately in the customary fashion: for 
the e-th approximation we solve the first @ equations for the first Q 
unknowns with the remaining unknowns put equal to zero. In the second 
approximation, for example, we solve the equations 


ay t+ 5ag=%, 18a,=—}, 
and obtain 
BI) 1 
i 7) a Se 

Table V/11 gives the first four approximations for the coefficients 
of the power series, together with the values calculated from them for 
the key points of the square. The convergence of the successive approxi- 
mations is good. 
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Table V/11. First four approximations by the power series method 


1st 
approx- | 2nd approximation 


3rd approximation 4th approximation 


imation 

ay 3 0-75 2 0°81944 eee = 0°82131 nes 0°821 564 

ate 0 == — 001389 win —0-01432 |— Tne = —0-01440 

% 0 0 wae = 0000041 Teves = 0:0000493 

Gy 0 0 0 Tae = —0-000000 64 
4(0,0)| 0-75 0819444 ae = 0:821 306 ee = 0'824 $636 
u(0,1)] 0-50 0555555 eae = 0:557012 nee = 0°5572125 
u(1,4)] 0-25 0-375 Lt = 0379300 o3e = 03799924 


II. We now illustrate the opposite procedure on the plate problem of § 1.5 
Viu = x3, 


=4,=0 for |*|/=1, u=V?u%=0 for ve 47) 


i.e. we use a series which already satisfies all the boundary conditions: 


u= (1 — #7)2(4 — y*) » Any 2° ™ Ny (Y) 
m,n=0 


with 
nny) = (4n + 5) y2% — (40 + 1) 9? "43. 


Again we choose a series which also satisfies the symmetries of the problem. 


The expressions 74 ¥%,,,, are now worked out for the first few quantities 
Wein = (1—4%7)2(1 — y?) 42" 7, (y), but only as far as the highest powers which we 
intend to consider. We will illustrate the procedure with a quite crude three-term 
approximation involving only 49, 491, 4,9 For this we need only those terms of 
V+, which are O(%?+ y?), and by substituting in the differential equation and 


equating coefficients we obtain: 


absolute term: 10a 9— 204),— 124,)>=0, 

1 
factor multiplying #?: —14dag9+ 4649; + 1004,9= vay 
factor multiplying y?: —10d9g+ 140d), + 1449=0. 


Solution of this system of equations yields 
35 mt! ull 


= —__—___ = ——_——_—_, ang= oo: 
400= 34x 2487’ “88-48 x 2487 10°" "12 X 2487 
The approximate value 
u(0, 0) F& 5 ayy = 0:00293 


corresponding to this three-term approximation is still very crude and more terms 
must be taken into consideration if any real accuracy is to be attained. 
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4.6. Eigenfunction expansions 


The set of expansion functions VY is often chosen as the set of eigen- 
functions of the associated eigenvalue problem. Consider a linear in- 
homogeneous boundary-value problem of the form 


L{u*| =r" im B, 
(4.18) 
U ju )=v, onl (#=4,...,&), 
where, as usual, J" is the boundary of a two(or more)-dimensional region 
B, L and the U, are given linear differential expressions, 7* and the v, 
are given functions of position, and u* is to be determined. We suppose 
that the boundary conditions U,[u*]=v, render the determination 
unique. First of all we reduce the problem to one with homogeneous 
boundary conditions: if w* is any function which satisfies the inhomo- 
geneous boundary conditions, and also possesses derivatives of a suffi- 
ciently high order (so that L[w*] exists), then the function « =u*—«u* 
satisfies a linear boundary-value problem with homogeneous boundary 
conditions, namely 


Li) =" —7* — Lie). ines. 
(4.19) 
U,[u] =0 onl” Tilia = 1 Geek) 
We now suppose that the eigenvalue problem 
Lly|=ay in B, 
m i (4.20) 
U.[y]=O onl (w=1,...,&) 
possesses a complete system of eigenfunctions y,, p2, ... corresponding 
to the eigenvalues A,, A,,..., and expand the function 7 in (4.19) into a 


uniformly convergent series of these eigenfunctions (we assume that this 
is possible) : 


if = Zee: (4 21) 
Then ne 
t= eH, (4.22) 
e=1 @ 


is the solution of the inhomogeneous boundary-value problem (4.19), 
assuming that L[u] may be formed term by term for this series (4.22). 


Example. The boundary-value problem which arises in the problem 
of the torsion of prisms (cf. Example I, § 3.4) is customarily reduced 
to one with homogeneous boundary conditions by putting w* = x?-+ y?: 
apart from a constant factor we obtain 


V2ue=—1 inB, 
“u=0 on I". 
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Let us consider a prism of rectangular section bounded by the lines 
fe ete 4), 
The eigenfunctions of the associated eigenvalue problem 
Vu—Au imnB, «w=0 onl 
are given by 


* m 
Yn = sin chs 


sin “<7 (m,n = 1, 2,...) 


and the corresponding eigenvalues by 


Ann = (= oo =) ae 


a 


The eigenfunction expansion of the function 7 = —1 is here a double 
Fourier expansion 


=1= 5! tmasin sin a for 0<*<4, 0<y<6b, (4.23) 


m,n=1 


so that the coefficients c,, ,, are Fourier coefficients. They are obtained 
by the well-known method of multiplying by ¥, , and integrating over 
the fundamental region: 


a b a b 

 DBES -_ guy - 9 PUK Pare tae ee ab 
— ene =a x 9c sin? &—" dx | sin?=-dy=c, ,—. 
fein - sin “| 4y=Cp,q = i Camm 0, i 
0 0 0 


0 
This yields 


Coa — 


janie when at least one of #, ¢ is even, 
- | 


— any when both # and g are odd. 


The solution (4.22) therefore reads 


ee sin eae sin ee 
Oo ae > pg)’ ee 
PP, odd pa (2 + “| ; 


where #, g run through all pairs of odd positive integers. 


Let us evaluate the value at the centre point for the special case of a square 
section. From (4.24) 
P+d 4 


u(’ +) = 16a? ba (— 1) 
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where 
C) 2k-1 4 
Ps _— 4\kt1 . = Pee a Pe 
S= >) (—1)**" 4, with A; BoE 
1 j=1,3,5,... 
jodd 
for example, 
2 2 2 2 1 
4.= Premera and) A,= er a | aa 


This rearrangement of the double series (permissible because of the absolute 
convergence), in which terms with the same p+ q, and therefore with the same 
Sign, are grouped together into the finite sums A; converts it into an alternating 


Table V/12. Evaluation of the alternating series for the value at the cenire 


First smoothing Second smoothing 
| os 
1 4 4 
2 —0-133 33333 0:86666667 | 0:91077873 
3 0:043 114.94 0:909 781 58 0°894 18493 0°899 263 10 
4 —0°01927171 0°890 509 87 0°89790383 | 0°89667191 
5 0-010 30412 0-900 81399 0°89669503 | 0:89711961 
6 —0:00617112 0°894 64227 0-89718455 | 0-89700470 
7 0-003 997 44 0°898 63968 0°89695466 | 0:89704204 
8 —0-002 74267 0:895 89704 0:89707429 | 089702754 
9 0:001 96644 0:897 86345 0°89700691 | 0-89703385 
10 —0:001459 73 0°896403 72 089704729 | 0:89703084 
14 0:001 11455 0°897 51827 0:89702187 | 0:89703239 
12 —0:00087105 0-896 647 22 0°897 038 53 
13 0:000 694.17 0-897 341 39 


simple series S in the A,; moreover, these A, are easy to calculate, since the 
denominators are the differences of the fourth powers 1, 16, 81,.... Table Na 
gives the calculated values for k up to 13 of the quantities 4,, the partial sums 


k ; 
Sp= >, (—1)'t1.4,; and the quantities s,, sj which are obtained from the sp by 
$=1 
smoothing: 


Sh = 4(Sp-at 2se+ Spaz), sy = F(sp_y + 254 + 5443) 


(this smoothing process gains three more decimals). We deduce from these figures 
that to six decimals 

S = 0:897 032, 
and hence 


a@ «@ 
ae eee || tee te} a 
u(Z, *) 0-073 67134". 


For the special case of a square of side a=2 (cf. Example I, § 3.4) we have 
u(1, 1) = 0:294685. 


For this example the series method would appear to be far superior to all 
other methods. 
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§5. The Ritz method 


5.1. The Ritz method for linear boundary-value problems 
of the second order 

As in the case of ordinary differential equations (Ch. IIT, § 5), it is also possible 
for many boundary-value problems of even order in partial differential equations 
to specify an integral expression J[g] which can be formed for a certain class of 
functions g and which assumes its minimum value just for that function «4 which 
satisfies the boundary-value problem, and therefore to find an approximate solution 
of the boundary-value problem by inserting an approximation function for gy in 
J{p] and determining the parameters to make J a minimum for this restricted 
class of functions. 


For a boundary-value problem of the second order in two independent 


variables we consider the variational problem [corresponding to (5.6) 
in Ch. IIT] 


a eee Seb Oe, + Ppl 2¢ pldra yc 
+ f(Se?+2To)ds | ey 
r 


and investigate the range of boundary-value problems which can be 
covered by it. B is assumed to be a bounded, simply-connected, closed 
region with a piecewise-smooth boundary curve J’, along which the arc 
length s is measured anti-clockwise from some fixed point. The extre- 
mum, which we may suppose for definiteness to be a minimum, shall 
be relative to the set of values of J obtained by letting g run through the 
domain of continuous functions which possess continuous partial deri- 
vatives of up to and including the second order and which also satisfy 
on J’ a certain linear boundary condition of the form 


a, (s) p + a2 (s) p. + 43(S) Py = 44(s), (5.2) 


which will be specified more precisely later. We assume that there is 
a smallest value of J and a corresponding function « among the ad- 
missible functions g for which J assumes this smallest value. The 
question of the existence of a minimum of / will not be pursued further 
here. Thus we suppose that 


J(w] S$ Ji]. (5.3) 


If 4(x, y) is any function with continuous second partial derivatives 
which satisfies the homogeneous boundary condition corresponding to 
(5.2), i.e. 

an+azsn,+a43n,=0 onl, (5.4) 


then p=u+ey is an admissible function for any value of «, and 
J(u-+en] =e) is a function of ¢ which assumes its minimum value 
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for =O and whose derivative with respect to e must therefore vanish 
at ¢=0: 


®'(0) = (ae) =0. (5.5) 


e=0 


By inserting gy =u-+ ey in (5.1) and calculating the derivative in (5.5) 
we obtain 


40'(0) = J[u,n] +ffrudxdy— fTuds=o, 
B r 
where J[u, 7] is the integral of the corresponding bilinear expression: 


Tle. ¥)] = SJ [A ee + BUp Vy + Pye) + C Oy +E Gy — * 
i - 


transformation of the double integral by means of GREEN’S formula 
[Ch. I (3.4)] then yields 


$D'(0) = ff n{Llu] —rdedy — fn L*[ulds+ fn(Su+T)ds=o, (5.7) 


in which L[u], L*[u] are the linear differential expressions defined in 


Chile G23), (325% 
L{u]=— 2 (Au,+ Bu,) -% (Bu, +Cu,) +Fu, 
L*[u] = (Au,+ Bu,) cos(v, x) + (Bu, + Cu,) cos(y, y). 


Now (5.7) can hold for all functions 7(x, y) satisfying the present 
conditions only if the factor L[w]—r vanishes identically in B. This 
follows by the same argument as was used in Ch. III, § 5.2: if L[wj—r 
were not equal to zero, but were positive say, at some interior point 
(%, Yo) of B, then by continuity it would also be positive in a small 
neighbourhood (% — %9)?-+ (vy — Vo)? 6? of (x9, ¥), and for any 7) function 
which satisfies (5.7), say 1=7*(x. v), we could specify another, 1 =7**, 
which does not: 


pena [TE LG x0 + (y= yet — BP for (x= ag (wy) SOF 
n* otherwise. 


Consequently « must satisfy the differential equation 


Lie 7 (x0), (5.8) 
called the Euler equation of the variational problem, and (5.7) reduces to 
fn L**{ujds =o, (5.9) 


do 
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where 
L**(u] = Su+ T—L*=Su4+T— (Au,+ Bu,) cos(y, x) — 


— (Bu, + Cu,) cos(y, y). oe 


If our assumption of the existence of a minimizing function w is not 
to be contradicted, this boundary condition (5.9) must be compatible 
with the boundary condition (5.2) (with g replaced by ); we see 
immediately that this is not always possible, and proceed to discuss the 
conditions under which it is. 


5.2. Discussion of various boundary conditions 


We distinguish two cases according as w is or is not prescribed on 
the boundary I’. 


Case I. First boundary-value problem. Here the boundary values 
of « are prescribed: 


u(s)=g(s) onl. (5.11) 


The corresponding homogeneous boundary condition for 7 is therefore 
ny =0 on J‘ and the necessary condition (5.9) is automatically satisfied ; 
thus no condition is imposed on L**[w] and we may choose S = i. 

Case II. Third boundary-value problem. Here the value of a linear 
combination of « and its first partial derivatives as in (5.2) is prescribed 
on the boundary J’. Consequently there are functions 7 which are not 
zero on J’, and therefore in (5.9) we must have L**[u] =0; this condition 
is therefore to be identifiable with the boundary condition (5.2). Let 
us denote the direction cosines of the inward normal » by 


a =cos(v,x) = —cos(s,y), B=cos(r, y) =cos(s, x) (5.12) 
and express , and q, in terms of the normal and tangential derivatives 
g, and 9,: 


Px = 29, + BP, (5.13) 


Py =BY.— &Ps- 


Then the two boundary conditions (5.2) and L**(u] =0, which are to 
represent the same condition, read 


ap + ioe a3 o 7a az B) Ps; =F (ay a+ a3 B) a,=0, (5.14) 
Su+[(C—A) aB-+B (o2—f?)]«,—[Aa®?+2BaB-+C Bp] m,+T=0. (5.45) 


If we regard the differential equation as prescribed, so that AMBeC 
are fixed, we have only two quantities Sand T at our disposal in (5.15), 
and it is clear that they cannot be chosen to make (5.15) equivalent 
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to (5.14) unless the coefficients in the given boundary condition are 
such that the ratio of the coefficients of the partial derivatives in each 
of these two equations are the same: 


@ _ —a43a+agB _ (A —C)aB — Bia? — pf?) 

as aga -+ az B Aa’?+ 2BaB+ CP 
We exclude the case when the denominator vanishes identically (on the 
boundary), for then the boundary condition provides a relation between 
u and u,, ie. a differential equation for the boundary value u/(s), and 
by integration of this differential equation the boundary-value problem 
can be reduced to a first boundary-value problem. The denominator 
can still vanish on parts of the boundary J’ without vanishing everywhere 
on it. As this case will not be pursued any further, we will assume 
here that Aa?42BaB6+C6?+0 on I. The results of the last two 
sections can then be summarized in the following 


(5.16) 


Theorem: The boundary-value problem 
2) 7) . = 
Li[uj =— ag u, + Bu,) a ae Cu,)+Fu =7(x,yyin B, (5.17) 
a, (s) u + a2 (s) 4, + a, (s) u, = ay(s) on I (5.18) 


with as 0 may be written as the necessary Euler conditions for a variational 
problem of the form 


Iel= ff [Agi +2Bo,9,+Ce+Fg—2rgldxdy+ 


=A 
+ f(Sq?+2T 9) ds =extremum Goa 
of 
if and only if the coefficients satisfy the condition 
at MA = Oe Bee (5.20) 
as Aa®+2BaBicp ? co 
where 
a=cos(y,x), B=cos(r, y). 
S and T are necessarily related to the other coefficients by 
S = — (Ao®+2Bap + Cp?) 4 
: (5:24) 


T= + (Aa? + 2Bap + Cp) “6, 
3 


but the functions y admitted for comparison need not be restricted to satisfy 
any boundary conditions. 

For the corresponding first boundary-value problem, i.e. for the case 
A,=az=0, a,=+ 0, the values of S and T are irrelevant, and may be taken 
to be zero, but it is now essential that the admissible functions ¢ all satisfy 
the boundary condition: p(s) =a,/a, on I. 
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5.3. A special class of boundary-value problems 


We specialize the results of the last section by taking A =—C and 
B=0O; this leaves the class of differential equations of the form 


_ se [A(x, y) 4] — a [A(x, y)4,] + F(x, y)u—r(x,y) mB, (5.22) 


which occur frequently in applications. To satisfy the condition (5.19) 
we must also take a,=0; thus we restrict ourselves to boundary condi- 
tions of the form 


ay (s) # + ag(s) 4, =ay(s) onl’, (5.23) 


which also occur frequently in practice. 


Then for the case a =+ 0 the corresponding variational problem reads 
(since a«?-+-f?= 1) 


Jlel= ff (A@i+ 9) + Fe —2rgldxdyt 


= y (5.24) 
+ fz (— 4,9? + 2a,¢) ds = extremum, 
Je 


for which g need not satisfy any boundary conditions. 


For the case 4,0, 4-+0 the boundary integral in (5.24) may be 
omitted, but the admissible functions y must all take the boundary 
value a,/a, on I’. 


5.4, Example 


Once more we consider the heat conduction problem 


V?2u = —1 in the interior 
of the square |x|<1, |y|S1. (5.25) 
éujéy—=% on the boundary 


From § 5.3 the corresponding variational problem reads 
Jigl=SS (pe +9 — 2p] dxdy+ feds =extremum, (5.26) 
B r 


for which @ need not satisfy any boundary conditions. Using polynomial 
approximation functions which already satisfy the symmetry conditions, 
we take for our first approximation the two-parameter expression 


gp =a + a, (x? +9"). 
With 
Py = 242%, Py = 24, 
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we obtain 
[f (e+ —29]dxdy =—8a,— Pa, + 2 a, 
B 


[ Pas=8ai+ aja, + eat 
r€ 


hence 
Jlg] =8 [at + Saya, -+ 2 aj — a, — =a]. (5.27) 


Table V/13. Results for the heat conduction problem obtained by Ritz’s method 


Three-parameter expression 


Two-parameter expression 


Approximate value | Error Approximate value 
a a Eel. =qae nee, 0: : 
*=0, y=0 16 Y 078125 1°1% 16g 082738 +0°7% 
#=0, V=1 37 os 05781 +3°8% AT ng 055952 | +0:4% 
: 64 84 ie 
11 8 
x*=1, y=1 32 FY 0°3438 | —9°5% Bae fs 0°38095 +0°25% 


8 @a, 
14 oJ 8 32 2 
SS — ae — @,— — 
8 aa, 3 a ee ee 
we obtain a,= =, a= — - , and hence the approximate solution 


p= [52 — 15 (x8 + 9%]. 
Several numerical values, together with their errors, are given in 


Table V/13. 


For a better approximation we use the three-parameter expression 


Y =a, + ay (x2 + y?) + a, x2 2. 
J is now given by 


1 8 16 2 88 2 
g Jig] =at+ 3 a = at 3 aa, + 45 faa ae a Fa ot 


and the extremum conditions 


2 
8 Oa, Px pei soem (Oy 3 —-i=0, 
i —_: 32 88 2 
~~ eee ee en 
1 of 2 88 14 1 
8 day 53 a, + 45 a, + 15 ay 9 = 0) 
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yield Z 139 AS wees 


The new approximate solution is 
1 
oe ae 45 (x® + y?) + 15 x4 y?); 
numerical values at key points are compared with the first approximation in 


Table V/13. 


In this example J has been worked out as a quadratic function of 
the a, for illustration; this is not essential, for the differentiations with 
respect to the parameters can be performed before the integral is 
evaluated, i.e. under the integral sign, and in fact the calculation can 
often be shortened thereby. 


5.5. A differential equation of the fourth order 
For the plate problem! of § 1.5 


Vo — in B: |x|S1, |y|S4, (5.28) 


u=u,=0 for |x| =1, u=V%u=0 for |y|=1 (5.29) 


we consider an integral expression of the form? 
Hel = ff |Wor—25 9] andy. (5.30) 
B 


To investigate the associated variational problem we proceed exactly 
as in §5.1, and can therefore be brief. We put p=u-+en and form 
@(c) =J[u+en]; then (5.5), which here reads 


oro)=(2)_=2 [f(r ba)ertymo, 639 


provides a necessary condition to be satisfied by w if it is to minimize 


JT¢].- 
If we apply GREEN’s formula [Ch. I (3.8)] with p= V2u, p=, Le. 


ff (ve Vn —V'u)dxdy = { (n —- Vu au) as, (5.32) 
mi r 


to the first term in the double integral of (5.31), the necessary extremum 


1 More general problems of stressed elastic bodies have been considered by 
WEBER; he obtains bounds for the displacements by making use of two minimum 
principles. C. WEBER: Eingrenzung von Verschiebungen mit Hilfe der Minimal- 
satze. Z. Angew. Math. Mech. 22, 126— 130 (1942). — Eingrenzung von Verschie- 
bungen und Zerrungen mit Hilfe der Minimalsatze. Z. Angew. Math. Mech. 22, 
130— 136 (1942). 

2 By way of further literature on variational problems for double integrals 
involving second derivatives we may mention A. R. ForsyTuH: Calculus of varia- 
tions, 656 pp. Cambridge 1927, in particular Ch. XI, pp. 567—600. 
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condition (5.31) becomes 


[far — 3) Laue a — Vu 1) ds=0. (5.33) 


The paseuior of boundary curve I’, arc length s and inward normal » 
follow those in Ch. I, § 3.4. 

As before, the factor multiplying 7 in the double integral must 
vanish, and hence the minimizing function « must satisfy the given 
differential equation. Thus the double integral vanishes. In order that 
the boundary integral shall also vanish we must demand that 7=0 every- 
where on the boundary and that é7/@y=0 on the parts of the boundary 
where the plate is clamped; the second boundary condition on the rest 
of the boundary, V27 =0, may be suppressed, since the fact that we 
do not demand the vanishing of y, on this part of the boundary auto- 
matically ensures that the minimizing function u satisfies V/2u =0 here; 
we say that V?u =O isa “natural” boundary condition for the variational 
problem J[g~] min. Thus, as in the case of ordinary differential equa- 
tions, the admissible functions g must satisfy the essential boundary 
conditions, but need not satisfy the suppressible boundary conditions. 
Unless the latter are also natural boundary conditions, as in the present 
example, J[p] must be modified by the addition of suitable boundary 
integral expressions so as to obtain a variational problem for which the 
suppressible boundary conditions are natural, otherwise they will not 
be satisfied by the minimizing function 4. 

As a family of admissible functions for the present example we could 
use, for instance, 


p= (1 — 22)° (1 — y?) (ay + ag x9 + gy? + ay 4 + ay x8 98 + ayy); 
these satisfy all the essential boundary conditions and also the appro- 
priate symmetry conditions. To illustrate the method we will use the 
one-parameter family obtained by putting all parameters but a, equal 
to zero; the integral in (5.30) becomes 


ang 125) | 08 ee 
Jgl=F (Sat—- 4), (5.34) 
and the condition @J/@a,—0 leads to 

a, = 9(0, 0) = sie & 0-00435. 


5.6. Direct proof of two minimum principles for a biharmonic 
boundary-value problem 
Consider the boundary-value problem 
Vin (x,y) inB, (5.35) 
u = f(s), u, = g(s) on P (5.36) 
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with region B, boundary J’, inward normal y as in § 3.5, and assume the 
existence of a solution u. 

Now let v and w be functions satisfying the differential equation 
and boundary conditions, respectively: 


vp in B; wy, w,=g on I". (5.37) 
Then from (3.38) of Ch. I we have 


Div —w]=D[v—4]+Dlu—vw], (5.38) 
and hence 
D[v—u]SD[v — w] (5.39) 
and 
D[u — wv] <D[v — wv]. (5.40) 


Each of these two inequalities contains a minimum principle. 


I. Consider first (5.39). On account of (5.38) we have equality if 
and only if D[u —w] =0. Now from the definition of D[g], Ch. I (3.34), 
D[g] =O implies that V?y =0; further V?(u —w) =O in Bwithu—w=0 
on the boundary J’ implies that »—w=0 in B. Consequently 


D{v—u]=D{v—w] ifandonlyif u=w. 
With each side expanded as in (3.35) of Ch. I, (5.39) here reads 
D{v] — 2D[u,v] + D[u] S$ Div] —2D[v,w] + Dw]. (5.41) 


If we put p=v, y=u—vw in (3.37) of Ch. I, the boundary integral 
vanishes on account of (5.37) and we have 


D[u — w,v] = D[u,v] — D'w,v] = ff (u—w) Vivdxdy 
= ff (u—w) Pudedy. 
Hence (5.41) may be sien 
Sf [(W2u)?— 2uViuldxdys ff (W?w)? — 2wViuldxdy. (5.42) 
This result can be stated as the a 


Theorem: If w runs through the class of functions which possess 
continuous partial derivatives of the second order and satisfy the boundary 
conditions in (5.37), ue. w=}, w,=g on I’, then the integral 


J{v] mut [(V?w)? — 2wpldxdy (5.43) 


assumes its minimum value when and only when w =u, where w rs the 
solution of the boundary-value problem (5.35), (5.36). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 28 
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II. The treatment of the second inequality (5.40) is quite analogous. 
On account of (5.38) we have equality if and only if D[u—v]=0, Le. 
V2[u—v] =v. If we put p=u—v, y=w in (3.37) of Ch. I, the double 
integral on the right-hand side disappears and we have 


D[u —v, wv] = D[u, w] — Dp, w} = [w {V?(u —v)},—w,V?(u—v) | ds. 
The inequality (5.40), which can be written in the form 
D[u] — 2D [u, w] + D[w] < D[v] — 2D[v, w] + Dlwl, 
therefore yields 
LS Viaiandy - 2 J [w(V2u), — w, V2] ds 
si (VEU sa aay _ 2J [w(V2v) —w,V2v] ds. 


Thus we may state the 


Theorem!. If v runs through the class of functions which possess 
continuous partial derivatives of the fourth order and satisfy the differential 
equation Vtvu—=pP of (5.37), then the integral 


Jf] = JJ (Vintaxdy +2 [ge Vv — f(V?v),| ds (5.44) 


assumes a minimum value for all functions of the form u+q, where u 
is the solution of the boundary-value problem (5.35), (5.36) and is any 
admissible function with V?@ =0. 


Example. We choose an example similar to one considered by 
WEGNER (loc. cit.). For a uniformly loaded rectangular plate whose 
edges are clamped and have lengths in the ratio 1:2 we have 


ein 
“= tel onl 
ov 


where J" is the boundary of the rectangle B with |x| <2, |y|<1. 
Let us assume for V?v an expression of the form 


= sie me dow with g,=re(x + iy)” 


1 Established for homogeneous boundary conditions f= g=0 by U. WEGNER: 
Ein neues Verfahren zur Berechnung der Spannungen in Scheiben. Forsch.-Arb. 
Ing.-Wes. 13, 114—149 (1942), and for inhomogeneous boundary conditions by 
J. B. Diaz and H. J. GREENBERG: Upper and lower bounds for the solution of 
the first biharmonic boundary-value problem. J. Math. Phys. 27, 193—2014 (1948). 
WEGNER also gives numerical examples. 
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then V4v =1 for arbitrary c,. Since the boundary conditions are homo- 
geneous, the boundary integral in (5.44) does not appear, and the 
conditions 0 J/éc,=0 (for y=0, 4,..., p) read for p=1 


2eot 2 a+2=0, 


226 
20 ab 45 Cy cle : aes OF 
with the solution 
ee ee 
£6 a ey — 0-196, 1 Se Rs — 0-221; 
for  =2 the calculation yields 
1850 3945 
C, = —-C PA 68 — —— == — “2 
° 3x3671 ~ ae a 4x 3671 0-269, 
__ 100 
oy = se FY 00272. 


In this way we obtain directly an approximation for V?u instead of for 
u. Consequently the method is very suitable when the stress distribution 
is of most interest, but less so when the displacement has to be calculated. 


5.7. More than two independent variables 


We procede along the same lines! as in §§ 5.1—5.3, but because of 
the greater length and complexity of the formulae, we restrict ourselves 
to a simple case, namely that for which the differential equation is of 
the self-adjoint form (5.49); and further we present this simple case 
more concisely. 

Corresponding to (5.1) we consider the variational problem 


= ay a 
Fil= f (3 Ange oh + 408-219) ae + 
Bae 


(5.45) 
+f (K g?+ 2M) dS =extremum, 
r 


where B is a given, finite, simply-connected, (say) closed region of the 
(%1, %p,---, %m) Space bounded by a closed surface I” which is made up 
of a finite number of ‘‘faces’’, each with a continuously turning tangent 
plane; dt =dx,dx, ...dx,, denotes, as in Ch. I, § 3.2, the volume element 
in B, and dS the surface element on J’; 4;,,9,7 and A, M are given 
continuous functions of position in B and on J’, respectively; further 
the A,, are symmetric (A,;—A,,) and possess continuous first partial 
derivatives. The domain of admissible functions will be restricted to 


1 See also R. WEINSTOCK: Calculus of variations, 326 pp. New York-Toronto- 


London 1952. 
28* 
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those functions p(x, %2,---, %,) Which are continuous and have con- 
tinuous partial derivatives of up to and including the second order in B 
and which satisfy such boundary conditions on the boundary J” as are 
found to be necessary. Again we assume that there is an admissible 
function “(%,, 2, ---, %,) for which J attains its minimum value, and 
then derive conditions which must be satisfied by this function. Such 
a condition is that for any family of admissible functions of the form 
p=u+ten(%, Xo, +++, %_), Where é is a parameter, the function O(e)= 
J(u +n] must have a minimum value when e =0; hence the condition 
@’(0) =0 of (5.5) must be satisfied. 
Here we have 


+ (0) =a lee Jlu+en)} 


(5.46) 
ou 2a 
-f{ s AZ = ee, +qun—r\de+ f (Kun +Mn}ds =0. 
7 


#,k=1 


Now according to the formulae (3.13) to (3.15) of Ch. I 


< du 0 
fh > 4a A +quy}de= fn Llular— [nLe[Was, (5.47) 
B Fis 


1,k=1 


where L[w] and L*[u] are defined, as in Ch. I (3.12), (3.15), by 


— a Ou 
Lia}= — 2, Th (4: an +44, 
- Ou Ou 
L*(u] = A; bax, 08% %;) =A —>; 
ey ax da" 


we can therefore rewrite (5.46) in the form 
Beret —rndt+fn{Ku+M —L*[u]}}dS =0. (5.48) 
r 


By the usual argument it can be deduced from the arbitrariness of 
y that the factor multiplying 7 in the space integral must vanish inside 
B; thus as the Euler differential equation we obtain 


Lig os an (4sn-5 it 5e\+ qu =r. (5.49) 


t,k=1 


The necessary condition (5.48) then reduces to 
ee (5.50) 


For further discussion we select two special cases (not all boundary 
conditions can be dealt with by this method anyway). 
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5.8. Special cases 


Case I. First boundary-value problem. Here, since the value of u 
is prescribed on the boundary I’, say «=g, we must demand that 7 =0 
on I", i.e. that all admissible functions @ satisfy the boundary condition 
¢=gonT. Then the condition (5.50) is satisfied for arbitrary K and M; 
in particular, we can put K=M=0, i.e. we can omit the boundary 
integral in (5.45). 

Case II. Third boundary-value problem. Suppose that we require 


L*{uj+qu+w=o0 onl, 


where g, w are given functions of position. Here we minimize J for 
functions ¢ which are not prescribed on the boundary, so that the 
minimizing function « must satisfy Ku+M-—L*[u]=0 on I. Thus 
if we choose K = —g, M =—vw, the required boundary condition will 
be satisfied, and the admissible functions g need not be restricted by 
any boundary conditions. 


For the particular differential equations with 
p for 1=k 
Aj, = 842 = | 
0 for +=, 
where p is a given function of position in B, the above boundary condi- 
tion reads 
pu,+qu+w =O, 
where u, is the derivative in the direction of the inward normal. 
Example. For the three-dimensional problem 
Ue t Uyy + “4,,=0, 
eM _o for [z|=1, |[yxl=t, l4l=1. 
ov 
u=o for *=y=z=co with g=+1 


(temperature distribution in a cube (© as in & 1.7) the volume integral in (5.45) 
reduces to the Dirichlet integra] 


Jig) = SSS (grad p)?dxdydz (5.54) 

Cc 
and g need only satisfy the boundary condition gor at the corners x= ye z= a 
with o= —1. The simplest farmly of gdmussible functions which also satisfy the 


symmetries of the problem may be defined by 
g=a(atytz)+ (14 — 3a) xyz. 
Using this expression we have 
Gr=a~ (1 — 34) yz, 
4 J (yp) = 6a?—2a+%, 
and from ¢ ]/Ga=0 we obtain a) - 2. the approximate solution therefore reads 


paklar yay t are. 
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5.9. The mixed Ritz expression 


As in §5.7, let J[p] be an integral expression which is minimized 
with respect to a certain domain of admissible functions g by the 
function « which is the solution of a given (say) linear boundary-value 
problem with the differential equation 


Ll %q, %as +005 Kus 4, Ue, bg, +»-] =O 


and the boundary conditions U,{u]=y, («=1,...,k). The admissible 
functions g may have to satisfy certain boundary conditions (cf. § 5.7, 
for example), which we will denote by 


V[y] =, (a4, ee (5.52) 


The basis of the ordinary Ritz method is the minimization of J 
with respect to a p-parameter family of admissible functions defined by 
an expression of the form 


b 
Pp (xp) et Wo (x,) =F Day, (x,) ? (5.53) 


where wp, satisfies the inhomogeneous boundary conditions V, [wy] =v, 
and the w, for 1<v<p satisfy the corresponding homogeneous condi- 
tions V,[w,]=0. Now if there is an independent variable, x, say, 
derivatives with respect to which do not occur in the boundary con- 
ditions, then ¢, as defined in (5.53), would still satisfy the boundary 
conditions even if the a, were allowed to depend on x,, and were thus 
regarded as functions of x, to be determined}. This defines a wider 
class of admissible functions, which lies somewhere between the p-para- 
meter family (5.53) (an ordinary Ritz expression, leading to a system 
of linear equations for the a,) and the class of all admissible functions 
[with the a, depending on all the x,, so that the sum in (5.53) can 
be replaced by a single unknown function a(x,); this leads to the 
Euler differential equation of the variational problem). 

If we insert this ‘‘mixed” expression, in which the a, depend on a 
single variable x,, the integral expression J becomes a functional of 
the functions a,(x,); we write 


j= Ila, (%,)] . 


1 KanrTorovicn, L.: Sur une méthode directe de la solution approximative du 
probleme du minimum d'un intégral double [Russian]. Leningrad Bull. Ac. Sci. 
7, 647—652 (1933) (Jb. Fortschr. Math. 59, 1149). The method has been used by 
Hit_EL Poritzky: The reduction of the solution of certain partial differential 
equations to ordinary differential equations. Trans. 5th Intern. Congr. Appl. Mech., 
Cambridge (Mass.) 1938, pp. 700—707, by N.S. SEMENow: Biegung von Recht- 
ecksplatten. Zbl. Mech. 11, 12 (1939) and also by E. METTLER: Allgemeine Theorie 
der Stabilitat erzwungener Schwingungen elastischer Korper. Ing.-Arch. 17, 
418—449 (1949), in particular p. 420 et seq. and p. 445 et seq. 
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The requirement that J be minimized leads to a system of Euler equa- 
tions consisting of # ordinary differential equations for the # unknown 
functions a, (x,). 


The method is also applicable to initial-/boundary-value problems 
(Ch. IV); if the time ¢ is one of the independent variables, it can be 
used as x,, and sometimes one can then draw conclusions about the 
behaviour of the solution as ¢ increases indefinitely}. 

Examples. I. Consider the first boundary-value problem 


4w— 7%, 4,2) In -B, 
u=0 onthe boundary I’ of B. 


According to § 5.3 the corresponding variational problem reads 
J{g] = f {(grad gp)? + 27 g}dr = min. 
B 


Let p=a(x) w(x, y, z), where w (or the product aw if w does not depend on +) 
vanishes on the boundary J. Then J[q] = /[a(*)w] = Ja}. We derive an Euler 
differential equation for the minimizing function A(%) by the usual procedure of 
putting a(x) = A(x) + en(x). We must have 


1 ( af[A + en] 


2 de ), no" f eraaca w), grad(nw)) +rnw}dt = 0. 
B 


By using formula (3.17) of Ch. I we can separate out 7 as a factor: 
a(A 

[nwt V2(A w) + r}dt — fro AS = Oz 

B r 
Now w (or the product aw), and hence also nw, vanishes on the boundary, so that 
the boundary integral is zero. The remaining volume integral can be written as 
a repeated integral of the form 

fn(z)[ Sf w{-VA (ze) w) + dydz ax, 
_B* (x) 

where B*(x) is the cross-section of B in the plane x=constant. We see that, 
on account of the arbitrariness of (x), the double integral over the cross-section 
B*(x) must vanish for each x in B. This yields an ordinary differential equation 
of the second order for A(x): 


Av | [ wtayae L 2a’ | | w te dydz+A [f[evrwayae— ff rwayde=o 
5 
Bt Bt B* 


Bt 
where dashes denote derivatives with respect to %. 

In the general formulation with w= 0 everywhere on I" the boundary conditions 
for A(x) are that it remains finite at the end-points, and the uniqueness depends 
on the fact that the differential equation is singular at the end-points; it may be 
more convenient, however, to choose w so that A must vanish at the end-points. 
With A(x) so determined A(x) w(x, y, z) is the desired approximate solution. 


1 An example is given by F. WEIDENHAMMER: Der eingespannte, axial pul- 
sierend belastete Stab als Stabilitatsproblem. Z. Angew. Math. Mech. 30, 235— 237 


(1950). 
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II. Example in which the fundamental region extends to infinity: 
V?u =0 in B; u(x, +1) =0, u(0,¥) =1—y?, 
where B is the region x20, |y|<1. Here we have to minimize the 


Dirichlet integral: 
LNG anes aa 


We first put p(x, vy) =(1 — y?) f(x); then with dashes denoting differen- 
tiation with respect to x the new functional J =/[/] is given by 


lee} 


shin= [(ere+serjas. 


If { =F (x) minimizes this integral, we have by the usual linear variation 
method 


oo 


ome) Als rs tras 


= fol-fere Slee [oe 


By the usual arguments depending on the arbitrariness of 7) the factor 
multiplying 7 in the integral must vanish, and also we must have 

7 (0) =F"'(co) =0., Thus F(x), must 
Table V/14. Approximations foru(x,0) satisfy the Euler uni 


One-t Two- Fr 
| eee) eee —-F"+4F =0 
hee ee ares with the me conditions 
0-5 0:4536 0-467 63 F(0) =1, F’(co) =0. Hence F(x) = 
0°75 0-3055 0°31673 e~**, where k=]/2:5, and 
1 0-2057, | 0:21414 


(x,y) = (1 — y3) e VRB 
Table V/14 gives a few sample values for comparison with the next 
approximation. 


A two-term expression 
P(%, ¥) = (1 — 9) fr (*) + (1 — 9*)9 fa (*) 


leads in exactly the same way to the pair of simultaneous ordinary differential 
equations 


8 16 4 16 

Ce a Le pale pared. = 
is) a5" | gees oe 
16 128 16 128 

— ES ee eee 
35 °° Sige” ag egy eee 


6.1. Derivation of the Trefftz equations ‘ 441 


_ with the boundary conditions F,(0)=1, F,(0)=0, A(o) = Fj(co) =0. It follows 
that 

F(*) =aeh* + (1 — a) eh 

F,(*) =beh* — beka*, 


where k, and &, are the negative roots of k*— 28k?+ 63 =0; if we put k?= 9, we 


have 
25°533 
= 144 //133 = 
on , 2:4674 


and a= ioe) -, b= Belles’ a. Some values of the approximation function 
2 133 16 
when y= 0 are given in Table V/14. 


§6. The Trefftz! method 


While the Ritz method is, in the sense of Ch.I, § 4.4, an interior method, 
the Trefftz method? belongs to the category of boundary methods, and therefore 
possesses over the Ritz method the advantages already.mentioned in Ch. I, § 4.1. 
Moreover, error estimation by means of the boundary-maximum theorem (§ 3) is 
in many ways more simple for the Trefftz method than for the Ritz method; see 
§ 6.3 and the example in § 6.5. 


6.1. Derivation of the Trefftz equations 


Consider the first boundary-value problem with the differential 
equation 


L{u] =— 4 (Au, + Bu,) — x (Bu,+Cu,)+Fu=r(x,y) in B (6.1) 


1 EricH TREFFI1z, born 21 February 1888, son of a Leipzig merchant, studied 
in Aachen, Géttingen and Strasbourg. He recieved much stimulation from his 
uncle, CARL RUNGE, whom he assisted at Géttingen and accompanied to New 
York when RuNGE went there as exchange professor in the Columbia University. 
He obtained his doctor’s degree at Strasbourg in 1913 with work instigated by 
v. Mises. After being wounded in the first World War he went to Aachen, where 
he became ordinary professor of applied mathematics in 1919. In 1922 he accepted 
a professorship in applied mechanics at Dresden, a post which he held until his 
death from a malignant disease on the 21 January 1937. In his obituary [Z. Angew. 
Math. Mech. 17, 1 (1937)] L. PRANDTL wrote of him: ‘‘His domestic happiness, 
the pleasure he took in his work, the devotion of his students and the affection 
of his friends made him a happy man.”’ His work in the field of mechanics was 
concerned chiefly with hydrodynamics, the theory of vibrations and elasticity 
[see R. GRAMMEL: Das wissenschaftliche Werk von Erich Trefftz. Z. Angew. 
Math. Mech. 18, 1—114 (1938)]. 

2 TreFrtz, E.: Ein Gegenstiick zum Ritzschen Verfahren. Verh. Kongr. Techn. 
Mech., Zitirich 1926, pp. 131—137. — Konvergenz und Fehlerschatzung beim Ritz- 
schen Verfahren. Math. Ann. 100, 503—521 (1928). In these papers the method 
is presented for the potential equation and the biharmonic equation; we shall 
restrict ourselves to second-order equations but of the more general type (6.1) 


and (6.21). 
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and the boundary condition 
u=g(s) onl’, (6.2) 


where s is the arc length along the boundary I’ of a region B as in § 5.1, 
F, 7, g are given continuous functions, A, B, C are given functions with 
continuous first partial derivatives and A >0, C>0, AC— B*>0, F20. 

Now suppose that we know a particular solution w of the inhomo- 
geneous equation (6.1) and a number of linearly independent solutions 
W,, Wy,..., W, Of the corresponding homogeneous equation: 


L@l=r, L[mJ=Llw)=--=Ly%J=0. 63) 
Then m 
W=w+ 2 a,W, (6.4) 


is also a solution of (6.1), and the a, are at our disposal for making W 
approximate the solution wu of the boundary-value problem as closely 
as possible. 

The obvious way of choosing the a, would be to employ one of the error 


distribution principles of Ch. I, § 4.2; by the least-squares method, for example, 
we would demand that 


*= f [W(s) —g(s)]?ds = min., (6.5) 
ip 


which on the insertion of the expression (6.4) for W yields the following sym- 


metric system of linear equations for the ay: 


m 
D4, fw, Weds = f(g —W) weds (Gir ot) (6.6) 
e=1 r r 

TREFF1z’s method of determining the a,, however, 1s based on quite 
a different principle and makes further use of the differential equation. 
As with Ritz’s method, we define the integral expression 


Jip,.y] = i [A @eYe + BG Yy + TY) + Coyy, + Foyldxdy (6.7) 


and put 
JTy.¢] =Jl¢].- (6.8) 


As addition law we have 


Jig +y] = Jie] + 2J le, y] + Jly). (6.9) 


Now /[g] is a measure of the total deviation of the function q from a 

constant (from zero in cases where F > 0 somewhere in B); for J[g]2=0, 

and J[y]=0 if and only if g,,¢, and Fg? vanish identically in B. 

TREIFTz’s method is to demand that the error ¢ in the linear combina- 

tion (6.4) = 

=-W—u=8 +> a,v,— (6.10) 
o=1 
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shall be as small as possible over the region B when assessed in terms 
of the measure /, i.e. 


Tel — ges eee. — u|—= min. (6.11) 
o=1 


In the cases when J measures the deviation from a constant which need 
not necessarily be zero, for example, when L is the Laplace operator 
(with A =C=1, B= F=0), this minimization leaves an additive constant 
free in W, which has to be determined by some other means; see the 
example in § 6.5. 


The necessary minimum conditions 


Rae 
a 


oy + Saw —4 
te _ 


5 =2]|0+ $40, 1 TI) eer) (6.42) 
e=1 
(oA ae 


yield a system of linear equations for the a, whose coefficients are 
double integrals over the region B. These integrals may be transformed 
into boundary integrals by means of GREEN’s formula (3.4) of Ch. I. 


With p=@+ >i 4,w,—u, y=w, this formula reads 
o=1 
Pt 255% _— |e ete eves) eee ase y + 
+ f (@+24,u,— 4) L*[wJds=0 (oe 
r e 
Here the first term vanishes by virtue of (6.12) and the second by virtue 
f (6.3); only the boundary integral remains, and since u“(s) =g(s) is 
known on the boundary, we have 


4, fw, L*{w,]ds= f (¢—w)L*|w,jds (o7=1,2,...,m). (6.13) 
e=1 LF 2 hs 


These are TREFFTZ’S equations. 


6.2. A maximum property 


w, chosen as a solution of the inhomogeneous differential equation 
(6.1), is a fixed function independent of the a,; consequently so also is 


@—wu. If the a, could be chosen ideally we would have 1 2, 4,w,t = 
g=1 


J (w—1]; we show that by TREFFTz’s met] od best Sa, w | approximates 
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J(@—4] from below. From (6.10) and (6.9) we have 
Jd. 4,1] = J[e+u—w] = Jw —u—e] 
= J{w —u] — 2] {Ww — 4, 2] + J fe]. 
Now #—u=e-— )\a,w,, so that, since J[g, y] is a bilinear functional, 
J(@ — u, 8] = J[e] —) 4, J [w,, 6]; 


but from (6.12) J[w,, ¢] =J[e, w,] =0, so that 
J[@ — 4, €]=Jle}. 


Consequently 
J{Zaq te] = Jw — ] — Ite), (6.44) 
and since J[¢] is non-negative, 
pe w,| < fiw —u). (6.45) 


If Ritz’s method is used to find an approximation for w—vu, the 
integral expression J|w@— u] is approximated from above; for¢=w—u 
is defined by the homogeneous differential equation L[¢]=0 and the 
known boundary values 


C(s) =w(s) — g{s), 


and is the solution of the variational problem 


Jig] =min., g=w(s)—g(s) onl 


(assuming, as in § 5.4, that a unique solution of this problem exists). 
Thus by using a Ritz expression 


Ce b= Hot E09 a 


where #y(s) = w(s) — g(s), 3, (s) =0 e Sop) on the boundary, but 
otherwise the #, are chosen arbitrarily from the class of continuous 
functions with continuous partial derivatives, we can determine from 


the necessary minimum conditions i lagesser (o=1, ..., P)tanapprak- 


mation # such that /[@| = /[C}. fy. — both TREFFTz’s and RITz’s 
method we can therefore bracket! the value of the integral /[w— wu]: 


7 Sa, wv, Zia (6.16) 


1 Another estimate is given by J. B. Diaz: On the estimation of torsional 
rigidity and other physical quantities. Proc. 1st Nat. Congr. Appl. Mech. 1953, 
pp. 259—263, and a further estimate in connection with the finite-difference method 
by G. Pétya: C. R. Acad. Sci., Paris 235, 995—997 (1952). 
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For many problems — the torsion problem! for a shaft of constant 
cross-section for example, — the value of this integral can be of greater 
interest than values of the dependent variable. 


6.3. Special case of the potential equation 


For the first boundary-value problem for the inhomogeneous poten- 
tial equation 
—V?u=r(x,y)inB, #=g(s) onl (6.17) 


the differential expression L[u] of (6.1) has 
Aaa, BS SO 
and the boundary expression L*(“] reduces to 
Py es 
L [yp] a oy” 
If wand wv, ..., w,, are solutions of the inhomogeneous and homogeneous 
differential equation, respectively, i.e. 
—V?w =r; Po, = "0, => = /*0, = 0; 


the unknowns a, in the approximate solution 
m 


umww+ >a,w, 
o=1 


are determined in TREFFTz’s method from the equations 


m 
D>, % f ay 
e=1 r 


In this special case the integral expressions (6.7), (6.8) read 


OWe SS ye - 
mds = { (g w) “Weds (6 =1,2,...,m). (6.48) 


r 


Jie. ¥] =e (Pz Px + Py Py) ax dy = [Sigvediqneeidigdadsy, 
J{¢] = (yi + yj) dxdy = [f grad*pdady, 


and we see that TREFFTz’s method requires that the mean square of the 
gradient of the error function, grad e, where 


e=wW+))a,v,—%, (6.19) 
o=1 
shall be as small as possible. 


1 The bracketing of the dependent variable is considered by C. WEBER, who 
makes use of auxiliary problems [Z. Angew. Math. Mech. 22, 126—136 (1942)]. 
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Error estimate. With the a, calculated from (6.18) inserted in (6.19) 
we form the error function ¢(s) along the boundary J’. If e,;, and énax 
are the smallest and largest values of ¢ on the boundary I’, then from 
the boundary-maximum theorem of § 3.1 we know that é lies within 
these limits also in B: 


Emin W + D) dg Wy — US Eqay- (6.20) 


6.4. More than two independent variables 


As with Ritz’s method, we can also extend TREFFTZ’s method to 
self-adjoint equations of the form (5.49) in higher dimensions: 


2 (4 inge) taesr (6.24) 


with A;,—A,,, but here we must also demand that the quadratic form 


m™ 
QO = 2 Asneizp (6.22) 
i,k=1 

shall be positive definite for all x, in B and that g=0. Apart from this, 
the assumptions we make concerning the region B, boundary J” and 
functions A;,, 9,7 are the same as in § 5.7. For the present we restrict 
ourselves to the first boundary-value problem with « =g prescribed on 
the boundary J’. 


The derivation of the Trefftz equations follows exactly the same 
lines as in §6.1. From a particular solution w of the inhomogeneous 
differential equation (6.21) and # linearly independent solutions w’,,..., W, 
of the corresponding homogeneous equation we form the function 


p 
W=o0 + > a, Wy, (6.23) 
@=1 


which satisfies the inhomogeneous equation (6.24) for arbitrary ay. 
Now we introduce the integral expression [(3.14) of Ch. I] 


Sly ¥ =e 450s =f + 9pyhat (6.24) 
and put 
Jig] =Jl9. ¢]. (6.25) 


From our assumptions concerning the coefficients A;, and q we have 
J{y]20, and J[p]=0 only if ég/éx,;=0, ie. p=constant (and only 
if p= 0 when g>0 somewhere in B). Thus, as before, we can use J[e] 
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as a measure of the deviation of the error function 
Bes 
e=W—u=w+)iaw,—u (6.26) 
e=1 


from a constant (which may be zero) and demand that this measure 
shall be as small as possible: 


p 
Ile] = J |@ + Da,w,— nu] =min. (6.27) 
e=1 
This yields the necessary conditions 


; me 
ge = 2 |B + Yap — 114] = 2 IT, m4] = 0 (u=1,...,P), (6.28) 


ub 


which may be transformed into 


7 eile dt—felL*[w,JdS=0 (u=1,...,p) (6.29) 


2 hg 


i 


by means of the formulae (3.13) to (3.15) of Ch. I. Since L[w,]=0 
we obtain the system of linear equations 


p 
2a, J w, L*(w,|aS =a (gG—w) Le laS (¢=1,...,p), (6.30) 


from which the a, are to be determined. 


If g =0 and the matrix A,, in (6.21) is the unit matrix (0;,), we have 
L{u|] =—V?u and L*[y] =dy/dv. 

The argument in § 6.2 leading to the result (6.15) applies equally 
well for the higher-dimensional measure J of (6.24), (6.25), so that here 
also the Trefftz approximation function is such that 


[a w4| <J(w —u). (6.31) 


6.5. Example 
The torsion problem for a shaft of square cross-section leads to the 
boundary-value problem 
V2e=—1 for |x|S4, |y| S14, 
“=0 for |x|=41 and for |y|=1. 


Here solutions w, w, satisfying the inhomogeneous and homogeneous 


differential equation, respectively, and also satisfying the symmetries 
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of the problem, are 

@ = —E (+52) 

w, = x4 — 6x7 y? + yt =re(x-+7y)4, 

Wy = x8 — 28 x8 y2 + 70 x4 y4 — 28 x? y8 + 48 = re(x +7 y)8. 
The function w=constant, which also satisfies the homogeneous equa- 
tion, may be disregarded for the present (cf. the remarks in § 6.1 about 
J[] measuring the deviation from a constant). The equations (6.18) 
for determining the constants a, can be written down immediately; 


because of the symmetries we need only take the boundary integral over 
a half-side, si %=1, OS yS1, and the equations for p=2 read 


Bef (i) t7=— FOB ty ut. 
0 


With the eer evaluated, for example, 


fle om) dy=— fats (1—3y°)dy ==, 
0 


0 


they read 
48 1664 1 
Bis ~—=0, 
7 99 ? al 3 
— 2084, + oS = tio 
from which we obtain 
3619 
4 79856’ 
_ 429 _ 
319424 


As mentioned previously, we have a disposable additive constant, 
so the Trefftz approximation can be written 


= —+ 3 2 14476 3 
w =O — EY) — sag et lr 
+ im (x : 


x8 — 6 4,2 44 _ 2 4/6 & 
aren 28 x8 y2 +- 70 x4 y4 — 28 x2 y® + 48); 


C will be determined so that the boundary values of w approximate the 
zero boundary value as closely as possible. On the boundary we have 


see = 93903, 
(2) eS y+iH(y), where y= io 


and 
3194247 (v) = — 5012 y2 + 15554 y4 — 12012 y8 + 429 8, 
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so that to determine C we need to find the variation o in the function 
f(y) over the interval OS ySX1; for then, with C =y+t4o—fmax, the 
boundary values of w will lie between 40 and —3¢. With the aid of 


the graph in Fig. V/28 we find that ¢ = are , and hence C =0-295 434. 


According to the error estimate of §6.3, the absolute error in 
w cannot exceed jo any- 
where in the square. In 
particular, for 4(0, 0) we have 
the strict limits 


519424 Fy) 


Ce = = 0:2936 < u(0, 0) 


S0-2972=C+<., 


Fig. V/28. Variation of the function f (yy. 


6.6. Generalization to the second and third boundary-value problems 


Here we describe a different way of deriving the Trefftz equations 
(6.30) which is applicable to the second and third boundary-value 
problems also. Consider again the differential equation (6.21) but let 
the boundary condition be of the more general type 


Asee A, El = A, (6.32) 


on the boundary J’, where A, A,, A; are given functions of position 
on I’ and L*[u] =A 2" is as defined by (3.15) of Ch. I. 


As in § 6.1, we determine an approximation of the form 
p 
uwW=w+)4,w,, 
e=1 


where w and w,,..., w, are solutions of the inhomogeneous and homo- 
geneous differential equation, respectively, as in (6.3), but here we 
apply GREEN’s theorem in the form (3.16) of Ch.I directly to the 
functions p=u4—wandy=w,. Since L[u—w] =L[w,] =0, the volume 
integrals disappear and we have 


z {(u —w) L*[w.])—w,L*[u—w}}dS=0 (9 =1,...,p). (6.33) 
1 A similar approach is considered by M. Picone: Sur le calcul de la déformation 
d’un solide élastique encastré. 7th Internat. Congr. Appl. Mech., London 1948, 
and G. FicHErRa: Risultati concernenti la risoluzioni delle equazioni funzionali 
lineari dovuti all’ Insituto Nazionale per le applicazioni del calcolo. Mem. Accad. 
Naz. Lincei, Sci. Fis. Math., Ser. VIII 3, Sez. I, Fasc. 1, Rome 1950. — See also 
J. ALBRECHT: Eine einheitliche Herleitung der Gleichungen von TREFFTz und 
GaLERKIN. Z. Angew. Math. Mech. 35, 193—195 (1955). 


Collatz, Numerical treatment, 3rd edit., 2nd print. 29 
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First of all let us consider the first boundary-value problem again. 
Here u—w is known on the boundary, but not L*[u—w]. We replace 


p 
“u—w in L*[u—w] by the approximation >) a,w, and obtain thereby 


o=1 
a system of # linear equations for the a,: 


p 
f (w—@) L*[w,.]dS— dia, fw, L*[w]dS=0 (9 =41,...,f). 
Ir ee 
On account of the relation 
Heat] —w,L*[w,|}dS =0, 


which follows from (3.16) of Ch. I with p=w,, y=w,, this system of 
linear equations is precisely the same as (6.30). 


Now consider the general boundary condition (6.32), firstly with 
A,+0onJ. Then on I‘ we have 


“u—@ =— 42 1*(u —w) + 4%, 
A, 


where 


and (6.33) can be written 


[Eta {3 L*[w,)+w,} —A$L*[w,])dS=0 (Q=1,...,0)- (6.34) 
r : 
p 
Here we can again replace L*[x —w] by S'a,L*[w,] to obtain a system 
tT=1 


of linear equations for the # unknowns a@,. For the cases in which .4,=+0 
we could also have expressed L*[u—w|] in terms of « —w; this would 
have led to a different system of equations for the a,. 

If A,=0 on J’, then L*[u] is known on I’; by replacing «—w by 
p 


>4,w, in the first term of the integrand in (6.33) we obtain the 
t=1 
equations 


p 
> 4, { wL*(o dS =f wo Ele —wydS (e=4)2.., 2): (635) 
t=1 I De 

If J’ consists of two parts J] and J, on which 4,0 and A,=0, 
respectively, we obtain a system of equations for the a, by splitting up 
the integral of (6.33) into one along J; and one along J3, and using the 
transformation which leads to (6.34) in the former and that which leads 
to (6.35) in the latter. Again no volume integrals have to be evaluated; 
all the coefficients are expressed in terms of boundary integrals. 
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6.7. Miscellaneous exercises on Chapter V 


1. Transformer field. Calculate a solution of LAPLACE’s equation V?4~=0 in 
the annular region between two concentric squares (Fig. V/29) on the boundaries 
of which » is constant at a different value on each, say O on the outer boundary 
and 1 on the inner. This is a problem for which the finite-difference method is 
particularly suitable; with other methods, series expansions, for instance, difficulty 
is experienced in dealing with the boundary conditions. 


2. Torsion of an I-section girder. Let the cross-section of a girder be composed 
of seven squares of side a arranged as in Fig. V/30 to form an I-shaped region. 


eee A Ae 2 ae 
Fig. V/29. Transformer field Fig. V/30. Torsion of a girder of I section 
The Prandtl stress function satisfies V?u = — 2 inside of this region and on the 


boundary #=0. Solve this problem approximately by the finite-difference 
method with 


(a) the mesh width h = a/2 (cf. Fig. V/30), 
(b) the mesh width h = a/4 (cf. Fig. V/35), 
(c) the mesh width 4 = a/2 again, but by the Hermitian method of § 2.5. 


3. Solve the torsion problem of § 6.5, i.e. 


Vee=—1 for {|x| S14, |y|S1, 
“=0 form | |e _sanatfor = ||| = 41, 


by assuming a power series solution of the form 


Calculate in particular (0, 0). 
4. For comparison, solve the problem of the last exercise again, this time 
using a series expansion of the form 


1{— #*) (1 a y?) Bin y (42% 2% + HAM 2M) | 


which already satisfies the boundary conditions and symmetries of the problem. 
Substitute this series in the differential equation and equate coefficients. 
5. For the same problem as in 3. and 4. compare the ordinary finite-difference 
method with the Hermitian method for 4 = #4. 
29* 
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6. Normal modes of vibration of the air in a room. The amplitude of the 
vibration satisfies the equation 


av eu a?v 


Ox? Oy? rie Es 


in which the constant x is related to the natural frequency and represents an 
eigenvalue parameter to be determined. The boundary conditions are that v=0 
on fixed walls and 0v/dv = 0 (v being the inward 
normal) on the boundaries of the room across 
which the air can move freely. 

Consider here arectangular room which has 
fixed walls with dimensions a=4m, )=6m, 
c=4m as in Fig. V/31 and with two open 


ap 


Fig. V/31. Natural acoustic frequencies of a room 


12 


4m 


2m 


doorways, one in the centre of each of the long walls and measuring 4m xX 2m. 
If the system of co-ordinates x, y,z is chosen as in Fig. V/31, the problem can 
be reduced to 

atu au 


2 — =— 
P24 Bat ay 


by assuming solutions of the form v=u(x, y) sin(mz/c); A is a new eigenvalue 
parameter. 


Determine the first few eigenvalues A approximately by means of the ordinary 
finite-difference method with 4 = 1m. 


7. One end-face of a solid cylinder of radius 1 (one unit of length) and length 2 
is kept at the temperature #—1 and the other at the temperature «= — 1 
(Fig. V/32), while from the curved surface heat is lost to the surroundings at a 
rate given by the boundary condition 


Ou 
=au. 
ov 
Use the finite-difference method to calculate approximately the steady temperature 
distribution (V24=0) in the cylinder for a=1 and a=5. 


1 See, for instance, A. G. WEBSTER and G. SzeGG6: Partielle Differentialglei- 
chungen der mathematischen Physik, p. 36. Leipzig and Berlin 1930. 
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8. Find Ritz approximations, using one term and two terms, respectively, for 
the solution of the problem 


3 1 
Ux, + Uyy + => 7t 1=0, w=0 for |2| =- > and for ly| = 
of Example II in § 1.5 (shear stress in a helical spring). 

9. Work out Example I of § 2.8 (concerning a loaded trapezoidal plate) with 
the smaller mesh width 4 = 4/4. 

10. A homogeneous membrane stretched over a square frame J” (length of 
side 1) has an elastic thread running through it along a diagonal D, which divides 
the square into two triangles B,, B, (Fig. V/33). The amplitude distribution 
u(x, y) for a normal mode of vibration satisfies the equations! 


V2u-+ Au=0 in B, and B,, 


u=oonl, 
Ou Ou Oru 
an, agg ogee ee 0 on D, 
ty 
7 
le 
 @ 


Fig. V/32. A potential problem with axial symmetry Fig. V/33. Membrane containing an elastic thread 


where s denotes the arc length along D and »,, v, are the inward normals from D 
into B,, B,, respectively; « is proportional to the tension in the thread and 9 to 
its density. With «=6, g@=1 determine the fundamental mode approximately by 
means of 


(a) the ordinary finite-difference method, 
(b) the Ritz method or the collocation method. 


41. In Example II of Ch. III, § 1.4 the steady temperature distribution in a 
rod in which heat was generated according to an exponential law was obtained 
by relaxation. A corresponding two-dimensional problem can be formulated as 


follows: 


u 
Put tt =o for |2)/S4, |¥| S14, 


#=0 for |z\'=1 andor |[y|/=4. 


(a) Find an approximate temperature distribution by the ordinary finite- 
difference method. 

(b) How do other methods such as Ritz's, GALERKIN’S, least-squares and 
collocation compare when applied to this non-linear problem ? 


1 Courant, R.: Uber die Anwendung der Variationsrechnung in der Theorie 
der Eigenschwingungen und iiber neue Klassen von Funktionalgleichungen. Acta 
Math. 49, 1—68 (1926), here p. 60. 
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6.8. Solutions 


4. Because of the symmetry we need only consider that part of the annular 
region which lies in one half-quadrant. The ordinary finite-difference method 
yields the following values: 


for h = A/2 0 0) 0) 
0-4167 0-2083 0) 

1 0-4167 0 

4 04583 OO 


=i 


( 


i 


i“ A 
ZL 4, 


4 


fl 4 


Lf 4 


| 
( 


| 
| 
qt 
ZALES es 


Fig. V/34. Potential distribution in a transformer coil 


INS 


for h= A/4 
0) 0 (a) 
0:09986 0:04993 0O 
0-30353 0-20170 0:09986 0 
0:47205 0-303 53 0:14782 O 
1 064057 0°39256 0:18789 0 
c 0:69765 0-438 27 O22 17 0 
1 Ove & WA) 0°45170 0:218514 0 


Assuming that the error in these results is O(h?) we can extrapolate to obtain 
the new approximate values 


0 0 0 
0:3845 0°1995 0) 
1 073845 0 
1 0:°4495 0 


Values obtained by the higher approximation method of §§ 2.3, 2.4 with 
h = A/2 are worse at as many points as they are better than those obtained by 
the ordinary finite-difference method with the same mesh width (Fig. V/34): 


0 0) 0 
0:405 16 0:21203 0 
1 040516 0 
1 0°46203 0 


The more accurate formulae are based on the inclusion of higher order terms 
in the Taylor expansion, whose validity is restricted by the presence of the sin- 
gularities at the corners of the inner square. 
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2. (a) Mesh width h=a/2. The five unknown function values Oi Capen Up 
(numbered as in Fig. V/30) satisfy the difference equations 


2h? = 4U,— U,=4U,—U—Us= 4U,— 2U,— U,= 4U,— U, —U, = 4U;— 2U,, 


from which we obtain 


251 
ol i * 2 
1 334 0-187 87a?, 
336 
U, = = 2 2 
2 334 0-254 50a“, 
425 
= h?=0: 2 
3 334 0°318 11a", 
360 
U,= h2 — (0 2 
ner 0:269 46a2, 
U 347 h2 2 3 2 A 
, = ——— h* = 0-259 73a". Fig. V/35. Numbering of the points of the 
334 finer mesh 


(b) Mesh width 4 = a/4. Let the unknown function values U,, U,, ... correspond 
to the points marked 1, 2,... in Fig. V/35. The calculation can easily be carried 
out exactly (without iteration) by putting U =a, U,=f, U,=y and expressing 


if 0.10259 0.18227 0.1797 01992 02152 
9 0.73370 020174 02425 02768 O35! 


if 0.70306 O15493 0.98667 02252 0.3125 
| ere ce es 
0 0.212 


Fig. V/36. Results of the finite-difference approximation for the shear stress in a twisted girder 


the remaining U, in terms of these first three unknowns. This is straightforward 
as far as U,,. Then the difference equation for the point 16 


4U,,—2U,— U,= 2h 


yields a relation between «, B and y. This relation can be used to reduce the size 
of the coefficients of «, 8, y at each step in the continuation of the calculation 
down the web, i.e. in the successive expressions for U,, to U,g. With the further 
relations implied by the conditions U,,= U5, Ujg= Uz, we have a system of 
equations for a, B, y, which yields 

% = 0°8207286 x 2h?, 

B = 1-064 7835 x 2h?, 

Y = 0°8244528 x 2h?. 


Fig. V/36 shows the approximate values of U,/a?, together with lines of shearing 
stress calculated from them by interpolation. 
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(c) The equations for the Hermitian method read 


24h? = 40U, — 8U, = 40U, — 8U,— 8U,—2U, 
= 40U, — 16U, — 8U, = 40U, — 8U, — 8U, — 4U, = 40U,— 16, 


and have the solution 


= ST ag 2 _, 2226 329-2 2 
U= 7582 a? = 0:2037347, U,= 7582 a* = 0°293 594*, 
2037 2027°7 
U.= ——— gi=o- 2 = Se at = 0:2 Zz. 
B 7582 a* = 0:268 664", f 7582 a* = 0:267 444 
= PI ey 2 
8 7583 a* = 0:31618 a", 


Most of the (c) values lie nearer to the (b) values than to the (a), ie. nearer 
to the values which are to be regarded as the more accurate; since the amount 
of computation involved in (c) is only a little greater than that in (a), the Hermitian 
method appears to be quite favourable in this case. 

3. We retain only those terms in the assumed power series solution which 
satisfy the symmetries of the problem, and arrange them in the form 


co n 
u= F) Dbn gt? —tey2e = =with by p= ba ng: 
n=0 e=0 


Substituting in the differential equation and equating coefficients, we obtain 


for m=1: 26, 9+ 2b;,= — 1, which (since b, 9= 0,4) yields 6, >= — 4, 
and for” > 1: 
Sig sees sh ee ie 1). 
ene ‘it~ “(204 2) (Ze 4) 
es 
2n 
bn,o= (— 1)" (27) bn, 0 (Go? =O), ths scenede 


Thus by ,=0 for m odd, and with by 9= Cm we have 
1 0° 2m mn 
Se ee 2 — 4)\¢ —2a042 
wa — Fett + Dom (8 (Co ete 


which satisfies the differential equation for arbitrary c,, [the factors multiplying 
the c,, are the real parts of the functions (¥ + 4y)4"]. 


For *=1 we must have u(1, y) =0, ie. all the coefficients of y®, y?, y4, ... in 
u(1, y) must vanish. This yields an infinite system of linear equations for the c,,: 
coefficient of yY9: 2=cyte+ cyt cyt t+ Cyt: 
i » Vt—-F= 66,+28¢e,+ 66cg+ 1200+ 190c,+ °°: 
00 poe OS y+ 70Cg+ 495cg+ 18204+ 4845¢,+-::: 
nn ys O= + 28¢,+ 924c,+ 8008¢,+ 38760c,+°:: 
i on HER = Cg + 495c, + 12870c, + 125970c,+ --: 


” » yo: O= 66¢3+ 8008c,+ 184756c,+ °°: 
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which is solved approximately as in § 4.5. Table V/15 shows the results of the 
first few approximations up to the sixth; the approximate value of (0, 0) is given 


by ¢. 


Table V/15. Results of the approximations of ordervy=1,..., 


The convergence is seen to be very good. 


4 

2 |0:291667 |—0-041 667 

3 |0:294005 1| —0-044 6429 

4 |0°2944328/—0-045 2303 
|0-294 565 6| —0-045 418 5 

6 '0:2946195| —0-045 4962 


4. It is a help in forming 


0-000 638 


—0:000 024 92 
—0'0000396 


0-000 8224 


0-000 891 1 0-000 001 5 


0-000 921 6}—0-0000476 |0-00000277!—0-000000 1029 


V?u to make a short table of the Laplacians V?s,, , 


of the symmetric functions s,, , = 2*"y2"4 #2"%y2™ which occur (Table V/16) ; the 
product multiplying 2,,,, can be expanded as Sy ,— Smit n—Smntit Sm41,n41° 
Such a table can be very useful for various other purposes also. 


Table V/16. Laplacians of various symmetric functions 


@ | V9 
zt4 ye | 4 
ciel 12 (x7 + y?) 
x2 y2 | a(ae 9) 
ites" 30(x4 + y4) 
HA y? + x2 yA 2(x4-+ y4) + 2447 y? 
eae 56 (7% + y®) 
wy? 4. w8y® | 2(x*-+ 98) + 30(4497 + x79") 
xty4 12 (at y?2 + x? y4) 
ile wie se 90 (*8 + y8) 
x8 yF4 e248 | 2(x8+4 ae 56 (x8 y2 + x28) 
8 yh + gh ys | 12 (x8 42+ x2 y8) + 60 x4 y4 


Substituting the series in 


the differential equation and equating coefficients, 


we obtain with 26,,,,— 8, the following infinite system of equations: 


coefficient of x° y®: 

»» (47+ y%): 

(4A + v4): 

a y®: 
ean") 
(xg 4 ty): 


os 


-? 


” 


os 


ll = — 4Bo: =f 4 bio. 


_O= 2Bo — = 16049 + 12bg9 + 2p, 
lies big —32bg9— 2B! + 302g9+ by 
= 2A dyg — 24 Dq9 — 248! + 24bg; 

- 2626 — $8by9— 209, 


The dotted lines mark off the successive finite systems from which the successive 


approximations are calculated 


(as in § 4.5). The corresponding approximate values 
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Table V/17. Results of the first four approximations by a series method 


bse ber 


A - 4 
Ao Bo | Error in £8, 


bio | Be Be 


1 


Ast = 0-25 —145 % = = | = 


| 
| 
7 | 
2nd = = 028571 — 3:0 %|0:03571 — _ | = a 
a | 
| 


3rd | 5 = 0-291667 |— 1-0 % | 0:041 667 ) 0:041 667 ca = 
4th see = 0-293381 — 0:44% | 0-043 381 | —0-000447 , 0-056351 —0-000447 0-012522 
| 


are given in Table V/17, which also gives the error in f,, the approximation for 
u(0, 0). 

5. The approximations for the function values a, 6, ¢ as defined in Fig. V/37 
are exhibited in Table V/18. Here the trivial increase in computational work 
0.0 60 0.0 entailed by the Hermitian method is handsomely repaid by 
the considerable gain in accuracy. 

6. For the amplitude distribution which is symmetric 
about both axes of symmetry G,, G, we have seven unknown 
values a,b,...,g as in Fig. V/33. By expressing all un- 
knowns in terms of a, b and y= 4— Ah? we obtain finally 


vy? — 145 + 373 — 167 = 0, 


Fig. V/37. Notation for which has the roots 
the torsion problem for 


a square shaft 


y=0, +0°7332, 41:6699, + 3:2671. 


The corresponding approximate eigenvalues A; are given in Table V/19, together 
with the corresponding results for the antisymmetric modes. 


Table V/18. Comparison of the ordinary and Hermitian finite-difference methods 


Ordinary finite-difference method 


Hermitian method 


| Results Equations Results 


Equations 


— ithe — —_ = { | — 1272 yy 

Vie a — 4 39 = 028125 40a — 325 8c=12hk 3 | @ 4312 = 029499 
1 q = _ 990 . 

—a+4b—2c a 33 0°21875 — 84+ 36b—16c¢=3 b= 4312 = 022959 
Pee a oe ane = ES 6: 

26+4¢= 4 € 64 04719 2a—1664+ 40¢c=3 ¢ 4812 0-181 59 


| Error ina: — 45% Error in a: + 01% 


7. Take cylindrical co-ordinates r,z as in Fig. V/32 and use a mesh in the 
(v, z) plane as in Fig. V/38 with hk — 2. With the notation of Fig. V/38 the boundary 


condition @u/dr = — u corresponds to 
2—h 74 2 
ia Sy nr tae ho. 
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Table V/19. Results for the natural acoustic frequencies of a room 


Mode symmetric about 
and antisymmetric about 
A, = 0°7329 ae 
r Ay = 2:330 pea A, = 1:864 
Approximate Aly = 3267 A, = 3586 oa Als 3 
eigenvalues A A, = 4 Aj = 4:414 | A, = 3-338 
Ay = 4-733 A, = 4:662 A 
A= 5-670 Ay,g= 6°414 A= 6°136 138 ~ 5 


As y—>0 the differential equation 
= 1 
a ee ie? uy + U,,=0 


tends to 2u,,+ 4,,=0. See Table V/20 for 
equations and results. 


In the case with greater heat loss at the 


boundary, i.e. with 0u/@r=—5u, we obtain 
temperatures which depart much more from the gig, V/38. Finite-difference mesh in a 
linear distribution u =z. cylinder 


Table V/20. Approximate temperature distribution in a cylinder 


Results 


Equations for the finite-difference method 


Ou 
for the case [> = —« for the case 5% — — u for the case 5% = — 51 


4: 


—i1 


ts 
1 —1 


1 1 1 


— b— 2c+8d 
— 9¢ + 50e—12f= 
—9d—12e4+38f/=—1 


| | 
0:5621 0:5480 0-4927 0°514 0-487 0°365 
| | 


| 


0 
1 
8) 
2 
0 
2|0:1760 01720 0-°1492 0°154 0141 0-094 


8. First of all the differential equation must be put into the self-adjoint 
form (5.17): 


Cu a) 


Cae € Fe” +(5—y)%=0. 


Ou 
oy 


Then from (5.20) the corresponding variational problem reads 
Tip] = SS (5 — v)-3 lp? + op} — 2g]dxdy = min., 
B 


where B is the rectangle given in the problem and the admissible functions p are 
to vanish on the boundary. We assume the two-parameter expression 


y= (1 — 9?) (1 — 447) (5 — y)®(a+ by), 
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Table V/21. Shear stress in a helical spring by Ritz's method 


One-parameter 
expression 


Two-parameter expression 


Approximate values 
for « (0, y) 


Solution 


7 — 
O = 7364 17025a—1931b= 
=0-0009637| 1931a¢+ 40655=0 


Equations 


525 
32 


Solution 


a=0-0010185 


b = 0:0004838 


—0-°5 |0-12025 |0-09691 
0°12046 | 0-127 32 
0:5 |0:065 86 | 0-086 14 


in which 0b is to be put equal to zero for a one-parameter approximation; the 
factor (5— y)® serves to simplify the calculation of the integrals which occur. 


See Table V/21 for the re: 


sults. 


In Fig. V/39 these results are compared with those obtained by the ordinary 


finite-difference method 


y inite-aiherence method) 
/ (points joined by means 
/ HE of French curves) 


Ban 


with mesh width h= 


SS 
Rie’s method = \ 
7-paromeser expressions» 
2- ee a 


” 


1 0 7 


Fig. V/39. Various approximations by Ritz’s method and the finite- 
difference method 


2) (0) 

—3 11 ~3 

Oo —3 10 
MMe 2 
ee 

O 1 —3 

0 1 0 

0 0 2 


=3 1 0 0 
= 3. 33 1 1 
1 =3 =8 0 
13° 3 @ = 3 
=) 12 ee 
Q) = 8 1 
=i 1 10 
2 —6 —-6 6 


1 


4° 


y 


The finite-difference method 


yields a curve for (0, ) 
which has a noticeably flat 
peak; further terms are 
needed in the Ritz approx- 
imation in order to be able 
to reproduce a curve of this 
shape. 

9. With function values 


denoted by a,b,... as in 

Fig. V/40 and 

gare ee 
ye! Pee 
the equations in matrix 


form read A * =r with 


A 43 = 


a 
b 
c 
d 
e 
f 
& 
i 


RR RR a OR Oe 


Solution of these equations yields the following pivotal values, which are set out 


in their mesh positions: 


cS a 0:0018400,  #=0-0024199, 


b = 0-001 6659, 
a= 0:000711@, 


= 0:0028200, 


i= 0:003 1310, 


g = 0-001 7309. 


10. (a) First take h=43. Let the function values be denoted by a,b as in 
Fig. V/41, let A be an approximate value for A and put « = Ah?®; then corresponding 
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to the differential equation we have 
2b—4a+pa=0 


To approximate the condition along the diagonal D we could replace du/dv, 


at the point b by 2—2 


, but this would give a very crude approximation; instead 


h y2 


Fig. V/40. Notation for the finer mesh on the trapezoidal plate 


we introduce an intermediate point c (Fig. V/41) and 
use for 0u/dy, the derivative at b of the parabola through 
the ordinates 0, c, b, along the line G,. The ordinate 
value c can be obtained by parabolic interpolation along 
the line G,; thus c= 2a and we have 
ize) _ —3b+4c—-0  —3b+3a 
Bn |» ha tj2 
This yields 
— 3b b — 2b 0 
se = 307 34: ang: cama 
42 —(4y2) 


as an approximation to the condition along D. 


+Ab=0 


As characteristic equation we have 
|—4-—-# 2 | 
cs = =p, 
| y2 —3-\2+e 


and from it we obtain 


= 2°513 and a 22°64 Fig. V/41. Notation and extra 
eS 5-902 ~ 53°41. pivotal points 
The corresponding solutions of the homogeneous equations are respectively 
a=1, b= 0°744, 


and 
a=1, b= —0:951. 
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Now take h = 14, let the function values be denoted by a, b, c, d as in Fig. V/441 
and introduce intermediate values along the line G, (calculated by parabolic inter- 
polation as for h==4). In matrix form the equations read 


YA ET P78 
with Ah?=yu=x-+ 4 and 
a 6) 2 (8) 0 
b 1 oO 1 1 
, Bey La ae oy a 6 
. 4 g V2 ri 
d Oe ee 3 22 = 44 
ie 8 4 


Here it is convenient to determine the first few eigenvalues by means of 
bracketing theorems?; this avoids having to set up and solve an algebraic equation 
of the fourth degree. We obtain 


m= 2-483; A,= 24-27; a= 4025, b=5, c= 4:93, d= 3-465, 
M%= 0°62; A,=54-1; @=10, b=31, c= —49, d= —3-23. 


The fundamental mode is depicted in Fig. V/42, in which the restraining 
influence of the thread can be discerned. The thread has this effect because «= 6 


x is large compared with 9g=1; if a had 
Fa 


“ been small and @ large it would have had 
h the opposite effect. 
FH 


d 2 
Fig. V/42, Fundamental mode of vibration of a + 6 ut (32) —- Agel ds = extremum 
membrane containing a thread ds 


(b) The Ritz variational problem reads 


j= ff t+ B-Agyaxay + 
B,+B, 


with » restricted to be zero on the boundary and continuous along D. To illustrate 
the method we find a very rough approximation using the one-parameter expressions 
p=axy in By, p=a(i—-*)(1—y) in B,. From 0J/@a=0 we obtain the ap- 


15(35—3)2) _ 
17 


41. (a) With the function values denoted by a, a as in Fig. V/43 we obtain 
the approximate values of Table V/22. 

We use these approximations to find rough starting values for an iterative 
solution of the equations for a finer mesh with 4 = +4 and function value notation 
a, b, c as in Fig. V/43. 


proximation A, = 27°14. 


The equations for the ordinary finite-difference method read 
8( 4a—46 )=1i+e%, 
8(—a+4b—2c)=1+4 2, (6.36) 
8 ( —2b+4c)=1+4+e°. 


* See, for instance, L. Cottarz: Eigenwertaufgaben mit technischen Anwen- 
dungen, p. 291 et seq. Leipzig 1949. 
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Table V/22. Rough approximations for a non-linear heat flow problem 


Ordinary finite-difference method Hermitian method 


k=l | h=} h=1 | h=} 


8a=—1-+ 6 9a=1-+ & 10a=—2-4 ¢ 99a = 14+ 106% 
a ae - oe a Co _ [0-2743 
3-204 3-382 3-495 ~~ (3-506 


For the ‘‘cool”’ solution (with the small u values) a suitable iteration process 
is to solve these equations with the current approximations substituted in the right- 
hand side. The calculation is best performed by inverting the matrix of coefficients 


Fig. V/43. Finite-difference meshes for a non-linear problem 


on the left-hand side, so that the (n+ 1)-th approximation is given explicitly in 
terms of the »-th approximation by 


Gn41=6442B+42C, 1284 = 1+ e™, 
byay=2442B42C, where 32B=1+ em 
Cnty= A+ B+3C, 64C =1+ 6%. 


Table V/23. Iterative solution of the non-linear finite-difference equations 


1-405 | 1-297 | 1:209 | 003758 | 01436 /|0-:06903 
1-384 | 1-284 | 1-214 |0-03725 |0-14275 |0-06919 
1°3822) 1-2830| 1-2138] 0-037 222 | 0:142688 Pera 


034 |0:26 (0-19 
0-325 |0-250 |0-194 

0°3237 0:2492 |0:1938 
0-323 53,0:24909,0-193 73 


WN Oo 


Successive stages of the iteration are shown in Table V/23. We infer that to four 
decimals the solution of the finite-difference equations is @= 0-3235, b =0-2491, 
Gi One sisi 

The #?-extrapolation of Ch. III (1.8) yields 


“(0, 0) & 0°334 


as a better approximation for the temperature at the centre. 

For the “‘hot’’ solution (with the much larger u values) we'start from rough 
values approximately ten times as great: ag= 3-4, b)= 2:6, Cg= 1:9. In this case, 
neither the above iteration process nor the corresponding inverse process, in which 
the current approximation is inserted in the left-hand sides of (6.36) instead of 
the right-hand sides and the next approximation obtained by solving for the 
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exponentials, is found to be suitable. We therefore employ the relaxation method 
of § 1.6, using the change produced by the inverse iteration just mentioned as the 
measure of the residual error, i.e. we define the residuals for approximations a, b, ¢ 
as the differences between these values and those obtained as the next approxi- 
mations a’, b’, c’ by inserting a, b, c in the left-hand sides of (6.36), solving for 
the exponentials and taking natural logarithms. We make corrections to the 
starting values so as to reduce the magnitude of the changes a—a’,.... The 
decrease in the sum S of the absolute values of these changes is a rough measure 
of the effectiveness of each step. The calculation is shown in Table V/24, which is 
set out in the same way as Table III/9 for the corresponding one-dimensional 
problem, with the addition of a column for S. So many steps were needed because 
the original starting values ay, by, cy were rather poor approximations. To accelerate 
the process a group relaxation was used in the last line of the table; an appropriate 
group correction a, 6, y can be calculated fairly accurately by virtue of the fact that 
the exponentials can be approximated closely by linear functions for small a, f, y. 
We want to choose these corrections so that the values a+a, b+, c+y satisfy 
(6.36). Now 32(a+a)—32(b+f)=1+e%t+%, for instance, can be written 
e* + 32a — 328 =e% - e(4-2)+@; since (a—a’) and a may be expected to be of 
the same order of magnitude, we expand the last exponential to obtain 32% — 32f = 
e“ [(a—a’) +a], and similarly for the other equations. With the values from the 
penultimate row of the table we have 


32% — 328 = 80-28{ 0-015+4«), 
—8a + 328 —16y= 6:52(—0:015+ 8), 
—16B8 + 32y= 2:84( 0:006+y) 


and hence 
a= —0-0163, 
p= —0-0131, 
y = — 0:0066. 


(b) Application of the Ritz method does not introduce any fundamental 
difficulties. A corresponding variational problem can be specified: 


Jig] = Sf (pt + 98 — py — e?)dxdy = extremum 
Q 


where Q is the square |x| <1, |y|S1 and ¢ is to vanish on the boundary of Q; 
and also an appropriate approximation function: 
p = (1 — #9) (1 — y*) [ag + a, (42 + y*) + a x8 y? + +]. 


Our difficulties start, however, when we come to evaluate the integrals which 
arise — even with a one-parameter approximation (only aj+ 0) they are quite 
formidable. By and large, one may say that any method which entails integration 
over the square is undesirable here. A method which does not suffer from this 
drawback is the collocation method, but in this method one is faced with the 
uncertainty regarding the choice of collocation points, 


Applying this method with the approximation 
urs w= (1 — #9) (1 — 9%) [ay + ay (7? + 9”)], 
we determine the parameters so that 
Vw = ag[—4-+ 2(a*+ y2)] + ay [4 — 16 (22 + 8) + 24.2798 + 2 (x4 + yA] 


is equal to — 4(1 +e”) at the collocation points. 
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For the first approximation (only a,+ 0) we have one collocation point to 
choose. One wee normally choose it roughly in the middle of the half-quadrant, 
say at x=}, y= 1+ (see Fig. V/44); this yields 


ac 
64 


SLL 
ANT LASS 


Fig. V/44. Collocation points for a non-linear heat flow problem 


&=968—1 with p= 


ag, 


from which we obtain the values 
p= es 
3°475 
and 
0°3356 
w (0,0) = a) = 
Pali=ste on 
How strongly dependent the results are on the choice of collocation points 
and how uncertain they are in consequence is shown in Table V/25; for comparison, 
results are given for some positions which obviously would not normally be chosen. 


Table V/25. Uncertainty in the results 


Collocation point | Value for a, 

7 — (ee, | 0-29 and 3.2 
*=1, y=0, |; 05 - 
#=%, y=}, | 0:382 and 7-61 
*=1, y=1, | co _ 


r a two-parameter approximation (including a,) with x=}, y=4 and 
y = ¢ as collocation points (Fig. V/44) it is convenient to write ag= 1344 — 52, 
(u—v), so that the collocation equations become 


rj 


Fo 
aes: 
4° 
16 


36u— 9v= u(y 4g ant), 


21 
~47 66 = t+ oe 


The first equation can be solved immediately for y in terms of u, and the second 
for w in terms of y, so that it is a simple matter to represent them graphically; 
their points of intersection are 


a= 5:8 


{" = 0:0438 ee ie == (0547) so) {, = 0:64 
a, = — 2-2. 


= 0:0485, 4,= 0:075, y= 0-50, so that ‘. 
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Chapter VI 
Integral and functional equations 


§1. General methods for integral equations 


1.1. Definitions 


An equation for a function u(x,, %2,..., x,) of independent vari- 
ables 4 mig, --.5 Hyein tessimplest case for a funétion (x), is called 
an integral equation when it involves an integral with the function « 
appearing in its integrand and with at least one of the arguments of u 
among its variables of integration. When the equation also involves 
somewhere a derivative of u, it is called an integro-differential equation. 

A special role is played by the linear integral equations 


6 
Af K(x, &) (6) dé =f (x) (4) 
and . 


b 
y (x) —AS K(x, &) y(&) dé =f (x) (1.2) 


of the first and second kinds, respectively, (written down here for the 
special case of one independent variable x). In these equations the 
“kernel” K(x, &) is a given, say continuous function of x and &, f(x) 
a given continuous function of x, and y(x) the function to be determined. 
The interval of integration (a, 6) may extend to infinity in one or both 
directions. 

The theorems and methods described in the following for integral 
equations with one independent variable x are all equally valid for inte- 
gral equations with several (finitely many) independent variables, in 
which the integration, instead of being taken over the fundamental 
interval ax<x<b, is taken over the corresponding fundamental region. 

If f(x) =0, the integral equation (1.2) is called homogeneous; other- 
wise inhomogeneous. For the inhomogeneous integral equation A is to 
be regarded as a given parameter, while for the homogeneous equation 
it is essentially an eigenvalue parameter since the integral equation 
then presents an eigenvalue problem, in which ordinarily the object is 
to determine those values of J, the eigenvalues, for which the integral 
equation possesses ‘‘non-trivial’’ solutions (i.e. solutions which do not 
vanish identically), correspondingly called the eigenfunctions. 

The integral equation (1.2) is said to be “regular’’ when the interval 
(a,b) is finite and the kernel A(x, é) is bounded and continuous!; 


1 The theorems for regular integral equations may easily be carried over to 
cases in which fewer assumptions are made about the kernel. The definitions of 
regular and singular integral equations used here follow those in PH. Frank and 
R.v. Mises: Differential- und Integralgleichungen der Mechanik und Physik, 
2nd ed., Vol. 1, p. 535. Brunswick 1930. 

30* 
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“singular” integral equations, for which the fundamental interval is 
infinite or the kernel violates the conditions of boundedness and con- 
tinuity, also occur frequently in applications (cf. § 3). 


If the upper limit of integration in (1.1) or (4.2) is replaced by the 
variable x, we obtain a ‘‘Volterra integral equation”’; corresponding to 
(1.2), for example, we have the Volterra integral equation of the second 
kind 


y(x) — AS Kx.) 9(6) db = 12). 


For regular integral equations there exists a complete theory?. 


A variety of applied problems give rise also to integro-differential 
equations; we shall frequently consider the following type of linear 
integro-differential equation: 


b 
MTy(«)] —4f K(x, &) N[y(€)] dé =f (x), (1.3) 

with boundary conditions 
UL) =y_ (WHA, 2,--s mm). (1.4) 


Here M[y] and N[y] are linear differential expressions in y as in 
Ch. III, (8.2), (8.3), M[y] being of order m2Z0, and U,[y] =y, are m 
given linear boundary conditions for y of the form (1.7), (4.8) of Ch. I. 
If M and WN are both of order zero, so that no derivatives appear in 
equation (1.3), then we have an ordinary integral equation of the form 
(14.2) and the boundary conditions drop out. 


Occasionally initial- and boundary-value problems in differential 
equations are reduced to integral equations”, cf. Examples I, II of § 4.3, 
but the importance of the connection between the two kinds of formula- 
tion would appear to lhe primarily in the theoretical field; for the 
numerical solution of a differential equation problem one generally 
prefers to apply the methods of Ch.s II to V directly rather than to 
first transform the problem into an integral equation. 


1 See, for instance, PH. FRANK and R.v. Mises: (see last footnote). — 
Courant, R., and D. HILBERT: Methods of mathematical physics, 1st English ed., 
Vol. I. New York: Interscience Publishers, Inc. 1953. — Hamer, G.: Integral- 
gleichungen, 2nd ed. Berlin 1949. — SCHMEIDLER, W.: Integralgleichungen mit 
Anwendungen in Physik und Technik, Vol. I, Lineare Integralgleichungen, 611 pp. 
Leipzig 1950. 

2 See, for instance, W. SCHMEIDLER: (see last footnote) pp. 328— 360. — CoL- 
LATz, L.: Eigenwertaufgaben, pp. 90—109. Leipzig 1949. 
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1.2. Replacement of the integrals by finite sums 


As for ordinary and partial differential equations, the finite-difference 
method is also a very generally applicable method for integral and 
integro-differential equations. In this method the derivatives are re- 
placed by finite expressions as in Ch. III, §1 and Ch. IV, § 4 and the 
integrals by sums derived from a quadrature formula of a suitable kind. 

We explain the method with reference to a not necessarily linear 
integral equation of the form 


J (x,8, 9), 9(6)) 48 =0 (1.5) 


with finite interval (a, d). 
Let us use a quadrature formula 


b " 
f F(x) dx =D A,F(x,) +R, (1.6) 


where the x, are chosen pivotal points in <a, b), the A, are appropriate 
weighting factors and R denotes the remainder iam Let Y; be an 
approximation for y(x;). If we write down (1.5) for X= 4%; end: replace 
the integral by a fied sum in accordance with the quadrature formula 
(1.6) without the remainder term, we obtain an equation for the approxi- 
mate values Y;: 


pea, O(a, s,, 1,7.) — is ee 
vy=1 
If such an equation is written down for j7=1, 2,...,”, we obtain a 


system of m (in general non-linear) equations for the same number of 
unknowns Y;. 
For the linear integral equation (1.2), for instance, the finite equa- 


tions read 
n—I1 


Y¥,— AM{AK; oY GN ee (etn) (1.7) 


when the quadrature formula used is the trapezium rule with the pivotal 
b— a 
points x;=a-+jh (pivotal interval h = = }. Here we have written 


A,,, and /, for K(x;,x,) and /(x,), respectively. Thus we have n +1 
linear equations for the Y,. 

If the integral equation is homogeneous, i.e. f(x) » 0, then the linear 
equations (1.7) are also homogeneous and have a non-trivial solution 
if and only if the determinant of the coefficients vanishes. This yields 
an algebraic equation for A of (in general) the (w+ 1)-th degree. The 
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roots A,, Ag, ..-, Ay41 of this algebraic equation are used as approximate 
values! for the first » +1 eigenvalues A,. 

If Stmpson’s rule or some other more accurate quadrature formula? 
is used, one should take care that it is applied only to intervals in which 
the integrand is differentiable sufficiently often; for an integrand with, 
say, a discontinuous derivative — as is the case, for example, with certain 
GREEN’s functions for differential equation problems — SImMpson’s rule 
can naturally yield worse results than the trapezium rule if applied 
indiscriminately. 


1.3. Examples 


I. Inhomogeneous linear integral equation of the second kind. 
In the first boundary-value problem of potential theory a solution 
u(x, y) of the potential equation is to be determined which takes given 
boundary values g() on the boundary I of a region B. Let the boundary 
curve I" be defined in terms of the boundary parameter ¢ by 


x=), y=nl). 


The solution may® be written in the form 


u(x,y) = f nl) Spat, (1.8) 
the 


1 WieLanpt, H.: Proc. Internat. Congr. Math. Amsterdam 1954, Vol. II, p. 391, 
and: Error bounds for eigenvalues of symmetric integral equations. Proc. Symp. 
Appl. Math. VI, New York-Toronto-London 1956, pp. 261—282, gives an error 
estimate for the approximate values A™ (for the eigenvalues A,) obtained by using 
the quadrature formula (1.6) in the case of a real, symmetric, square-integrable 
(cf. § 2.3) kernel K(x, &). If we imagine the A™ as the first »+ 1 members of an 
infinite sequence whose remaining members are all zero, and if the A, are numbered 
suitably, then there is a number C depending only on the kernel and on the qua- 
drature formula such that (for the interval (a, b> = (0, 1>) the estimate 


i 1 | 
———__| sC 
| A, Pita  a 
holds for all y; for the trapezium rule we can put 
meg 0154 (OK (x, &) | 
~ nm—1 xe Ox 
and for Simpson’s rule 
ee 
Ys — We ue | ax? 


2 Gauss’s and CHEBYSHEV’S quadrature formulae are recommended by E. J. 
Nystrom: Uber die praktische Auflésung von linearen Integralgleichungen und 
Anwendungen auf Randwertaufgaben der Potentialtheorie. Commentationes 
physico-mathematicae. Acta Soc. Sci. Fenn. 4, Nr. 15, 1—52. Helsingfors 1928. 
Error estimates are given by L. V. KantTorovicnu and Y. I. KryLov: Naherungs- 
methoden der héheren Analysis, pp. 94—155. Berlin 1956. 

3 Nystrom, E. J.: (see last footnote). 
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where # is the angle (see Fig. VI/1) defined by 


ee ey 
? = tan a= 


and y satisfies the integral equation of the second kind 


= aay. vgecesmtn(t) ==) (s) 
xu(s)+ f K(s,t) wat g(s) with K(s,¢)= a tan " EOEEG (1.9) 
ip 


{f, for example, I’ is the ellipse 
x=acost, y=bsint, aZ=b, (4.10) 
the formula for the kernel yields 


= ab 
NDS BERR a Preoale Fh oo 


Let us consider the particular example of the steady temperature distribution 
in a long cylinder of elliptical cross-section (Fig. VI/2) at the surface of which 


Fig. VI/1. The first boundary-vaiue problem of Fig. VI/2. Cross-section of an elliptical cylinder with the 
potential theory prescribed values for the temperature on the boundary 


[the boundary of the ellipse (1.10) with a=2, b=1] the temperature g(s) is 
prescribed as follows: g(s)=0 for y=0, g(s)=y for yO (linearly increasing 
temperature). Suppose that we are required to calculate approximately the 
temperature “(0, 0) at the centre of the cross-section. According to (1.9) we have 
to solve the integral equation 


bs 4 
2 sins for ORSs Siz, 
thdt= eS 
ants) + f s—3eos44 MY { 0 for —xSssSo 


—n 


(there are, of course, numerous other methods for the solution of this problem, 
hi, (Clay, WA 


With the pivotal interval h | there are nine unknown pivotal values (2 i) 


in the interval -ywXs<m. We can reduce this number by using the symmetry 
of the problem; if «4; denotes the corresponding approximate pivotal value, we have 


Mj = Ma-j- 
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If the integral is evaluated approximately by the trapezium rule, we obtain for 
the approximations pg, My, Mo, 4-1, 4-2 the linear equations 


4 
4ttg +0:25 fg+ 056174, +03 fot 1°389544+ Eg As 


4 
4m, +.0:2808u,+ 0°65 fy +0-9756u9+ 1-4 byt 069484. = ae = 0:9003, 
4 


4g +04 py +0:9756",+ 1:25 My t+ 0-°97564,+04 bwp»2=9, 
44+ 0°6948¢g+ 1-4 fy + 097569 +065 p+ 0-2808u_.=0, 
4g + He + 1°3895f, +03 = fot 0°5617M 41+ 025 U_a=O, 
with the solution (obtainable conveniently by iteration) 
[y= 0°3422, py =0°2329, fp = —0:0396, y= —0-1048, a= —01354. 
These values yield the approximation 
n 
u(0,0) = f =e = [2 (a + Mag) + 1°6 (Hy + U4) + Mo) = 0°4547 


2cos®¢ + ¢sin?¢ 
— 


for the temperature at the centre of the cross-section. 


II. An eigenvalue problem. In Exercise 11 of Ch. III, § 8.11 the 
problem representing the flexural vibrations of a cantilever, namely 


yV=AA+x)y,  y(0)=y'(0) =y"(1) =9'"(1) =0, (1.12) 


was treated by Ritz’s method. Here it will first be transformed into 
an integral equation with the aid of its GREEN’s function G(x, £). Since 
the problem 


y'¥ (x) =r(x), (0) =y¥'(0) =y"(4) = y'"(1) = 0 
is equivalent to 
: G&—x) for x<é, 


1 
y (x) = f G(x, E)r(é)d&, where G(x,é) = 
0 (3x—&) for xZ&, 


(1.12) may be replaced by the homogeneous integral equation of the 


second kind 
1 


y(a) = AS K(x, 8) (6) de with K(x,8) = G(s, 8) (1 +8). 

This kernel is unsymmetric, but it could easily be made symmetric 
by introducing s(x) = (x) \1 ++; however, for the following calculation 
it is more convenient to work with the unsymmetric kernel and so 
avoid the square roots. 

We illustrate several ways of replacing the integral by a finite sum 
by using different quadrature formulae. 
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1. Using the trapezium rule. This is the simplest method, but also 
the crudest, and accordingly the results are not at all accurate. 

First of all let us use just three pivotal points x=0,4,1. It is 
expedient to record the values of the kernel neatly in an array as in 
Table VI/1. 

If A, y,, ¥, are approximate values for 4, y(4), y(4), and if 1 =6/9, 
the approximate equations corresponding to the integral equation read 


1 
(for x = 3) en=plot2xintix), 
1 4 
(for x = 1) eye=>[0+2x Bt 4m], 
Table VI/1. Values of 6 K(x, &) Table V1/2. Values of 6K(z, &) 
x=0 | z=$ | «#=1 | *=0 | x=h§ | 4=§ Sil 
ae 5 | | | 48 | 168 324 
alll’, 9 ‘ “4 4 . | “81 nm =4 
eyo jt) otf o | 2) Ee 
—_* rs) 0 ra) eed | 5 | 8 20 32 
Sas 81 81 81 
c= On 20 Tad | oO "| 0 


With 40= 1 the determinant of this homogeneous system of equa- 
tions for y,, y. reads 


: 1 ae , 24 5-21 
is Zeroseare t= (19 + | 319), we that jew A= = 
8 168-5. 
Although the method using the trapezium rule is not to be recommended on 
account of its low accuracy, we apply it again with the smaller pivotal interval 
= and x=, 4, 2,1; in any case we shall need the corresponding values of the 
kernel (Table VI'2) when we apply the three-erghts rule in 2. below and also we 
introduce a matrix notation which will be needed later. 
If yz 1s an approximation for y(47), the corresponding homogeneous equations 


may be written concisely in the matrix form 


Az=02, (41.13) 
where 
yy 8 25 24 6 
229, |, Awe |e 0 8h), CN Ae | 
Vs. 32 140 162 
The required values of o are the latent roots of the matrix A; we obtain 
242°3 6:01 
(ef = 678 and hence A= 215 


0°95, 1530. 
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2. Using more accurate formulae. By using better quadrature for- 
mulae we can obtain more accurate values with the same amount of 
computation as in 1. not counting the calculation of the kernel values, 
which is the same in each case. 

With the pivotal points x =0, 4, 1 we use Simpson’s rule. Then the 
approximate equations corresponding to the integral equation become 


(with 9 =6/A) 


for x=#) em =Zltxo+4x emt iy], 
(for « = 14) ey=s[1x0t4x 2 ys +49]. 
From the usual determinant condition, which here reads 
3 5 
2 4 2 11 2 
15 oe = T re clear ae 
ome 
where tT = 69, we obtain 
2 5 (= 68571 
t= and A= “ = 
7 «1444; 


the value A= in particular is a very good approximation. 


With the pivotal points x=0,4, 2,1 one can use the ‘“‘three-eighths rule’’ 


3h 
ft) ax ~ 2 40) +3408) + 31(2h) +164)1; 
0 


this yields a matrix equation of the form (1.13) with 


8 25 16 6 
a=(2 80 56], o=2169=216~— . 
32 140 108 ; 


189-16 6351 
= 5:91 A e249 


0:95; 1390. 


and we obtain 


Naturally with so few pivotal points we cannot expect much accuracy from 
the approximations for the higher eigenvalues. 


III. An eigenvalue problem for a function of two independent 
variables. Consider the integral equation 


il 1 
u(x, y)=AS flxE+yn| ul(E,n) dédn. (1.14) 
1 


== 
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Here, instead of an ordinary integral, we have a double integral to 
approximate by a finite sum. For this there are again crude formulae 
and more accurate formulae at our disposal. For illustration of the 
method we confine ourselves to the simple formula 


f feGnaédnew % Sy (4, 4,), (1.45) 


= ¥, u=1 
in which the a, are a set of distinct points in the interval (—1, 1). 
If we first take »=2 and a,=—k, a,=k, 
and denote the pivotal values of u by a, b, c,d 
as in Fig. VI/3, we obtain the four approximate 
equations 
ya=2a+2¢d=nrd, 


ie a 20 = 9'C, 


where »y =1/(Ak?), A being an approximation _ Fig.V1/3. Notation for the eigen- 
f F) value problem of Example III 
or A. 


The determinant condition reduces to »?(4 —¥v)?=0, so 1f we exclude 
»=0 (which would give A = oo) we have the double root »y =4; the cor- 
responding eigenfunction is characterized by a=d, b=c, with a,b 
otherwise arbitrary, and the approximate 
eigenvalue A is 1/(47), where k is yet to be 
chosen. The choice k =} gives A =1; but a 
better choice is R=4)/3, for (1.15) then 
becomes CHEBYSHEV’S quadrature formula; 
the corresponding value of A is 0-75. 

For the larger number of pivotal points 
defined by »=3, 4.=—hk, a,=0, 43=k we 
exclude the case 1/4 =0 from the start and 


a Fig. VI/4. Notation for nine pivotal 
make use of the consequent centralsymmetry _ points (assuming central symmetry) 


about the point x=y=0. We are left with 
five unknown function values a,b,c, d,e as indicated in Fig. VI/4; 
these must satisfy the equations 


oa=2a+b +d 
ob= a+od+ ¢ 
0 b+2c+d 
Odie + ctd 
oe =O, 
where 9= - a Fig. VI/5 shows the corresponding eigenvalues and 


8A R? — 
eigenfunctions for the choice k = 3; the simple calculation involved can 


VI. Integral and functional equations 


476 


(III e1durexq) sayqeirea yuapuedapur om} yyIM UlaTqosd an[RAUasia ay) 10y SUOCTOUNJUAaRIa pue sanfeauaste ojeullxoiddy 


a0 f- £ BoO- 
t- #20 n20- b 

£ WZ0-n20 b- 
w0-£ t- 20 


“S/TA “B14 


Sthl- £ ok Shhi- HS@=-t- £ HS 
£ 28h0- 29h 0- L l- 6€80- BUE9O t 
£ 2840- 2H0- L L 6EGO 6EBO- k- 
Siml- Lb Ghht- HSC bt t-USZ- 
O259-=V £999°2 = FV 
ta-li= 9 9-9 
0 L O 
f- 0 f- 
OG te) 


GAZt b 
£ %thO 


£ Sth0 
SAgL fb 


L Shét 


HHO b 
SthO t 


£ Ghét 


E4590 =V 
LUN +iL=<Q9 


£ 
&L0 
£ 


M&O ¢£ 
Go 8&0 


&O t 


al os 
cae 
nes 
25 
3S 
a ll 
a 
og 
a, & 
a, 
wo 
| 
ie 
a 
+ 2 
cs 
a 
rle 
on 
cs |l 
= 
on) 
Bs 
< | 
. es 
> & 
7 
i=} 
= i 
nN 
Pe 
oO « 
> 8 
eo 
rd 
o | 
E | 
shy 
as 
el 
at 
eal 
Qs 


1.3, Examples 477 


which are likewise obtainable with only a short calculation. (The values 
are still fairly crude; cf. the values calculated in SHS) 

If k is chosen so that the error in the quadrature formula (Gls) os 
of as high an order as possible, it turns out that the approximations 
for the lower eigenvalues are improved, but that those for the higher 
eigenvalues are worsened. For » =3 the choice & =%)/2 (CHEBYSHEV’s 
quadrature formula) yields for A the approximations 2(17— 3) = 0-632, 
9 —— 9 rio — 7. =, = maa 1 AC. 
= = 1-125, Sa ~— 4.007; with n=4 and k= 2/15 we 
obtain for A the values ({/181— 411) = 0-613, 1-244, 25, —6-143, 
aa 75, 9-289. 

As in Ch. V, § 2.8, Example II, the computational work is greatly 
reduced if we postulate the various symmetries and anti-symmetries 
which can exist. 


IV. A non-linear integral equation. Consider the equation 
1 
(y(4) + (QP oe 1.16 
rear a ae to) 
0 
If we first make a very rough approximation to the integral by 
replacing the integrand by a constant, say its value at the midpoint 
=}, we find that for x =} 


g(2y(3)]? 1; sothat y(3) x +]iw = 0:707. 


If v(x) is a solution of the integral equation, then obviously so is — y(x). 
By using the trapezium rule for the integral we obtain the two 

equations 

(for x = 0) 4¥0 +3 (Yo t V1)? =2, 

(for x = 1) a(Yotv)?*+$ vi =2 
for the approximate values yo, y, of y(0), y(1). From these equations 
it follows immediately that 3y2=y?; for the remainder we restrict 
attention to the solution corresponding to y,=]/3 9 with the positive 
sign. For this solution we obtain 


Yo = 3 (6 — 3) =0:5086 and y, = y//3 ~ 0-8809. 


By using Simpson’s rule (with three approximate pivotal values yg, ¥,, v2 at 
the points ¥=0, 4, 1) we obtain the three non-linear equations 


(for ¥ = 0) 495 + 5 (Yo+ 1)? + F (Yo + Va)? = 6, 
(for ¥=2) = $ (¥ + 1)? + 89% + Bn, +)? =6, 
(for *=1)  B(Yo+ He)? + E(t Ha)? + 598 =6 
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These are best solved iteratively by expressing the principal term (underlined) in 
each equation in terms of the remaining ones, i.e. using the iterative scheme 
defined by 

yt 4 ye tt = [86 — 4 yf)? — Fol + yey]? 
for the first equation and similarly for the others, the bracketed superscripts [v] 
and [y+ 1] characterizing as usual the values obtained by the y-th and (y+ 1)-th 
cycles of the iteration procedure. 


The way in which the calculation is carried out is evident from Table VI/3, 
in which several cycles of the iteration are reproduced. The starting values 


Table V1/3. Iterative solution of the equations obtained by using SIMPSON’S rule 


yy) | yG 4 y | yi? a0 yl) yi] Es yh?) ylyt 4 yet 1) gr 1) yl Dy yly+ 1) 


| t 
hee 4-228  |0-7085| 1-569 


0}70°5 0-7 0:9 de? 1:4 1°6 

1]0-519 |0:709 | 0-864 | 1:228 | 1-380 | 1-569 1°221 0°7080 1°594 
21}0°513 |0:708 | 0-886 | 1:221 | 1°399 | 1°594 1°220 oeped| 1°576 
310-544 |0-706 | 0-870 | 


4°583 14-2210 [o7076] 4-5825 


0:°514 |0°706 | 0°877 | 1:220 | 1°391 
0:5134| 0-7076| 0-8749 


in 


Yo: V4, Yq are taken from the results obtained above with a smaller number of 
pivotal points. As shown in the table, the calculation can be shortened by estimating 
new starting values after a few cycles of the iteration. 


1.4. The iteration method 
With integral equations of the form 
b 
v(x) = f G(x, &, y(x), v(6)) dé (1.17) 


one can choose arbitrarily a function /j(v) and from it calculate a se- 
quence of functions f,, /,,... according to the iterative formula 


b 
Bas(s) =f G(x... BGye eae  Greomie,...). (ia 


For the linear integral equation (1.2) this formula! reads 
b 
Fua(®) =f) 44S KOO dE (m= 0,1,2,...), (1419) 


and the sequence F, (x) converges to the solution of the integral equation 
if the kernel A(x, é) satisfies the conditions laid down in § 2.3 and 


1 For cases in which the variation of A(x, €) with & is small C. WAGNER: 
On the numerical evaluation of Fredholm integral equations with the aid of the 
Liouville-Neumann series. J. Math. Phys. 30, 232—234 (1952), gives a correction 
which can be used to improve the values at the current stage of the iteration 
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|A|S]|4,|, where A, is the smallest in absolute value of the eigenvalues 
of the homogeneous integral equation! corresponding to (1.2). 

For eigenvalue problems [equation (1.2) with f(x) =0] the method 
parallels the iteration method in Ch. III, §8 for eigenvalue problems 
in ordinary differential equations. Here the iterative procedure is defined 


by 
b 
Fiii(x) =f K(x, 2) F(&)d— (wm =0,1,2,...), (1.20) 


and from the successive iterates we calculate the Schwarz constants 
and Schwarz quotients 


ar 


a,=fFy(x)F(x)dx, imu = 


Gr+4 


For symmetric kernels K(x, £) we can also write 
b 
a, =fSE(x)R_,(x)dx (0Sj7Sk; k=0,1,2,...). (4.22) 


The yz, then provide successive approximations to one of the eigen- 
values (care should be exercised in dealing with homogeneous integral 
equations with unsymmetric kernels, for they need not possess real 
eigenvalues). Error estimates have been established? for problems with 
symmetric kernels; if, in addition, the kernels are positive definite, the 
estimates for the smallest eigenvalue of Ch. III (8.18) are also valid 
mere, cf, § 2.3. 


1.5. Examples of the iteration method 


I. An eigenvalue problem. Consider again the integral equation 
(1.14), for which approximate solutions were obtained in § 1.3; these 


solutions suggest that 
Fy (x,y) =|x| +19 


should be a reasonable starting function. 
According to (4.20) we have now to calculate 


ft, 4) ae J let + yal (el |nl) 46an- (4.23) 


1A detailed and comprehensive presentation can be found in H. BUCKNER: 
Die praktische Behandlung von Integralgleichungen. (Ergebnisse der Angew. Math., 
H. 1.) Berlin-Géttingen-Heidelberg 1952. 

2 CotLatz, L.: Schrittweise Naherungen bei Integralgleichungen und Figen- 
wertproblemen. Math. Z. 46, 692—708 (1940). — IGLiscu, R.: Bemerkungen zu 
einigen von Herrn CoLLatz angegebenen Eigenwertabschatzungen bei linearen 
Integralgleichungen. Math. Ann. 118, 263—275 (1941). 
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In evaluating this integral we first suppose that y= > 0; in this half- 
eee we have 


SR= if (x& + ym) (5 +7) Jazan+ f fi (x€ + yn) (—E +) dodn+ 
—1 #& 
y 
iso , e 
7 # 
+f f @Etyn) E-1) edn = Fy +5, + ae 
0 aE 
: 
EF, is determined in the other seven half-quadrants of the fundamental 
region ae symmetry considerations. Then from (1.21) we have 


a= f { Raxdy— A ff ebaaeay 8H, 


—1 -—1 


2 
a= f frharey sf x+y) yt + Ea ldxdy=8x 2, 


—1 —1 


and similarly from (1.22) 


oud 
a= f [ Haxdy=8x a 


1680 
sil il 
Forming the corresponding Schwarz quotients, we obtain for the 
first eigenvalue the approximations 
as 


a ee. 
ar 58 Fe 0-603 45 and Lb, = 


gf 


ay 1624 


eae = 0:5985990. 


II. A non-linear integral equation. In order to apply the iteration 
method to the integral equation 


| a1 ; (1.24) 


we must first put it in the form (1.17). Naturally a general rule which 
will always be effective in producing the required form cannot be laid 
down for non-linear cases, but here we can derive a quadratic equation 
for y(x) by taking it outside of the integral sign: 


[y (x) ]® po(%) + 2y (x) gi(*) + pe(x) =1, (4.25) 


1 


p(x) = f WEN a (y@=20) 4,2) . 


where 


0 
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If we define 


OF, T(E)" dé, 


i rere ys 


where F(x) is the »-th approximation, and substitute it for y,(x) in 
the solution of (1.25), we obtain as the next approximation 


1 
oa 71, nt Voi, ro 2, n)|- (1.26) 
As starting function we choose F,(x) —constant =6; then with 
Eye li 2+* we obtain ae a ‘ ___§, We now determine 6 so 
i++ L(x) 


that Fj (x) and F, (x) are of the same order of magnitude, say by demand- 
ing that they take the same value at the mid-point x =4; this yields 


1 : : d 
Os Ee av 0-6996. Values of F(x) for this value of 6 are given in 
2 
Table VI/4. 
Table V1/4. Specimen values of the iterates 
x | Alz) | F(s) | Fete) | Fee) 
0 | 0:6996 0:5015 | 0:5 0°51852 
0:5 0:6996 0:6996 0-7 0°71135 
1 | 0:6996 0°8708 | 0-9 0:87969 


It is now convenient to round off A(x) to Fy*(x) =0-5 +0-4% and 
apply the next iteration step to /*(x), for which the integrations are 
much simpler: 


ie 0-4 + (0-1 — 0-4x) L(x), 
G2 1 (x) = 0-16(2 — x) + (0-4 — 0-4x)* L(x). 


We then calculate F*(x) from (1.26); specimen values are reproduced 
in Table VI/4. 


IiI. An error estimate for a non-linear equation. As an example 
of an equation for which the existence of and bounds for the solution 
can be deduced directly from the general iteration theorem of Ch. I, 
§ 5.2, consider the non-linear equation 


[av ) dé = y(x) 


(the application of the theorem does not always proceed so smoothly 
as for this equation). The operator 7 is here the integral operator 
defined by the left-hand side of the equation, and the equation 1s 
already of the form T y(x) =y(x) to which the theorem applies. 


Collatz, Numerical treatment, 3rd edit., znd print. 34 
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We must first define a norm, then determine a Lipschitz constant K 
as in Ch. I (5.8) for the operator 7. By TayLor’s theorem we have 


[A (6) — ta()146 
2/z+h +9606) —A6)’ 


TA() —Th(2) = [ 


where the values of # lie in the range 0<#<1. Now let us introduce 
as norm 


Lf | anace | (| 
for a continuous function /(x) in <0, 1), and as the sub-space F of Ch. I, 
§ 5.2 let us choose the sub-space of functions /(x) with O0<m</(x) for 


fixed m; then 
1 


. ag d 
a z = = a — aa 
|Th-Th\|SK|lh4—fhl| if K nex | Ss 2y/m 
i] 


Next we use one of the finite-sum methods of §§ 1.2, 1.3 to get a 
rough quantitative idea of a possible solution. The approximate values 
Yo, V1 for y (0), y(1) given by the approximate equations $ ( i % +) 1) =a, 
3 (1 +¥%+)4 +1) =, are Yo=1-17, y,=1-53. We therefore try m= 1 
and choose u(x) =a-+bx, where a=1-17 and b=0-36, as starting 
function. One step of the iteration procedure yields 


i (2) = THg(x) = [lx +a + 8) (x + aN); 


in particular, “,(0) =1-1610. By determining the maximum difference 


between “ and u, we find that ||1#,—%9||<0-01, and hence, since the 


1 


choice m =1 gives K = - and = 1, the ‘sphere’ 2 of Ch. I (5.43) 


consists of those functions h(x) with | —«,|<0-01; since this implies 
that h(x)=41, the sphere certainly lies in F, and consequently, by the 
general theorem of Ch. I, § 5.2, there exists precisely one function ¥(x) 
which satisfies the integral equation and the condition (x)=1, and 
this function lies in the strip |y(x) —1,(x)|<0-01. 


1.6. Error distribution principles 


The error distribution principles of Ch. I, §4, employed for the 
approximate solution of differential equations in Ch. III, § 4 and Ch. V, 
§ 4, can be employed similarly for the approximate solution of integral 
equations, 

We shall consider general integral equations in the form (4.5) and 
linear integral equations in the form (1.2). Let us assume for y(x) the 
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approximation b 
y (x) =~ w(x) = 2.4; v,(x). (1,27) 
I= 


Insertion of the approximation function w into the integral equation 
yields a residual error function ¢(x); for the general equation (4.5) 


&(x) = €(x,a,,..., 45) eo: E, w(x), w(é)) dé (1.28) 


and for the linear equation (4.2) 
b 
&(x) = &(%, q,..., a) = w(x) —AS K(x, &) w(E) dé — f(x). 


Again there are several principles on which the determination of 
the a; can be based; these were listed and described in detail in Ch. I, 
§ 4.2. Here we mention only the least-squares method and collocation. 


1. Least-squares method. Here we demand that 


b 
J=J(@, a, -..,4,) =f @ ax =min., (1.29) 


a 


and obtain in the necessary minimum conditions 


of _ 
Ca, - 


p (in general non-linear) equations for the a,. 


For the linear integral equation (1.2) we obtain the system of linear 
equations 


p 
olin = 7 7 =1,...,2) 


b b b 

dyn = J |vy(x) — AS K(x, 6) 0)(€) a8] [vy (x) — Af K(x, £) v4 (6) a8] dx 

and 
b b 
1 = JS ta)|oj(x) — AS K(x, €) (8) de| ae. 

2. Collocation. Here we demand that ¢ shall vanish at p points x, 

in the interval <a, b>: 
é(x,) =0 (0 =1,2,...,2; @im<%yQ< + <4, SS), 

which similarly yields # (in general non-linear) equations for the a,. 


Example. The non-linear integral equation 
1 
f Ve+Ely OP aE = ye) 
0 se 
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has the trivial solution y (x) =0, but also possesses a non-trivial solution. 
For this non-trivial solution we assume an approximation of the form 


yw =\a,+ a,x, 
thus departing somewhat from the usual procedure represented by 
(1.27); it is, however, a more obvious choice in this case. The residual 


error function which arises is given by 
1 


e (x) = [ V*+Elaa(x +6) + a, — a,x] dé — Va, +a, x 
ae) 5. ae , 3 _—— 
= fay(|/x+1 = )+ 2 (aq — a,x) (Vx+1 —]x)—Yataex. 
If we use first of alla single-parameter approximation with a@,=0, 
and determine a, in accordance with the collocation principle from 
1 ‘ 3/2 
é—@rat R= we find that a =— y2 ee 1-011. 


3V3—1 


If we incorporate both parameters a, and a,, and use x =} and x= $ 
as collocation points, a, and a, are to be determined from the system 
of non-linear equations 


1). 255-1 Be foe) 
(3) =e SIE" 4 (o— 9) SIE" Yt Pam 
5 \sme4o 7 — Os _ se 33 awl 3 
(2) = 0 SHOE 4 (4-29) 1S lane Payne 
To solve these equations we put a,=a,y. Then after dividing them 
through by Va we can immediately eliminate | a, between them and 
obtain an equation for y: 


4+3y 1°110342 + 0°592910y © 


This has the solution y = 1.8643, which yields a, = 0-4886, a, =0-9108; 
specimen values of the corresponding approximation for (x) are 


eX __ 0:848 362 + 0:474181y 


* | 0 fe OA5 est 


w(x) | 06990 | 0:9716 | 4:1830 


1,7, Connection with variational problems 


In order to extend the technique of Ch. III, §§5,6 and Ch. V, §5 
to integral equations, we must be able to find a variational problem 
whose Euler equation can be identified with the given integral equation. 
First of all we derive the Euler equation for a general class of variational 
problems, namely 

bb b 


J = J(u) = ff F(x, é, a(x), u(6) dxdé + f G (Eye) id event. (1.30) 
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with respect to the domain of continuous functions u(x) in the interval 
<a, b>; we shall assume here that the given functions F (x, &, 4, 4) and 
G(&,u) are continuous in all their arguments, x,&,u4,,u. and &,u, 
respectively. We derive here only the necessary Euler equation which 
must be satisfied by a solution y(x) if it exists, and assume that the 
variational problem (1.30) does, in fact, possess such a solution with 
the property that 
Ity) S J[4]. 


In the usual way we consider any one-parameter family of admissible 
functions of the form 


wy en, 
where e« is the parameter and 7 an admissible function. For this family 
of functions J[y + e7] = P(e) is a function of ¢ which must have a mini- 
mum value for ¢=0. A necessary condition that y shall minimize J is 


therefore that 


(ae). (geJ0+enl)_.=0 


&= 


for any admissible function 7. 


Let us denote the partial derivatives of F with respect to #, and u, 
and of G with respect to « by subscripts thus 


raw Wwe), Cog 


1 ou 

Taylor expansion of F yields 
F(x,&, y(x) + en(x), y(é) + en (&)) = F(x, é, v(x), (6) + 

+ en(x) F(x, &, v(x), v(&)) + en (6) A(x, 4, v(x), ¥(6) + 2..., 


and hence 


(5, JLy + en] ey 


oma aa 


b 


[n (x) + (é) Rl dxdé + fn(&)G,dé. 


Now in the second term in the integrand of the first integral we can 
interchange x and é, so that 7(x) will appear as a factor in both terms; 
further we can write x in place of € in the second integral. Our necessary 
condition can therefore be written 


b 
f n(x) Sdx=0, (1.34) 
where 


b 
Se fF ine, y wy) weF Sree), vie) ] deeG, (xyy(x)). (4.32) 
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Since (1.31) is to hold for any continuous function 7(x), S must 
vanish identically; thus S =0 is the necessary condition (Euler equation) 
for the variational problem (4.30). 

We now consider the inverse problem of finding a suitable variational 
problem for a given integral equation. We try to bring the integral 


equation 
b 


g(x, y(%)) + f h(x, & v(x), ¥(6) dé =0 (1.33) 


a 


into the form S=0. First of all we can put 


g(x,y) =G,(%,4), 
so that 


G(x, y) Be t) dt, (4.34) 


in which y, can be chosen arbitrarily. Sometimes it may be expedient 
to multiply the integral equation (1.33) through by a suitable function 
s(x) beforehand. 


In order to bring (1.33) into the form S =O we have yet to satisfy 


h(x, é, 9(x), 98) =R(o 690), Ve) FRE. Ws 


The question of the existence of a function F related to a given function / 
by (1.35) will not be pursued further here; we content ourselves with 
listing in Table VI/5 some typical possibilities obtained by calculating /; 
from some simple forms for F. 


Table V1/5. Some corresponding integrand functions 


F(x, &, v(x), 9 (€)) h(x, &, v(x), ¥(8)) 
3 K(x, &) y(x) y (é) $ (K(x, &) + K(E, x)] 9 (6) 
K(x, &) y (+) K(x, &) 
y (x) 
K(x, 8) J p(u) du | K(x, &) »(y(x)) 
K(x, &) p(y (*) ¥(€)) [K(x,&) + K(E, x)] p(y (*) 9 (6) » (8) 
K(x, &) p(y (x) + y()) [A (%, &) + K(&, x)] p(y (*) + (6) 


By referring to this table, which can easily be extended, and using 
(1.34) one can find a corresponding variational problem (1.30) for many 
cases of integral equations of the form (1.33); for example, for the linear 
integral equation 


y(x) —A f K(x, &) y(&) d& = f(x) (1.36) 
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with a symmetric kernel K(x, §) =K(&, x) we obtain the variational 
problem 


bb 
J(u] = BA Sf K(x, &) w(x) w(E)dxdé + 
4 4.37 
+ f (f(€) «(&) — 4[u(é)}*) d= = extremum. 


Examples. I. A linear inhomogeneous integral equation arising in 
a measurement problem. 

Suppose that when an attempt is made to measure an intensity distribution 
y(*), say along the section —1<+*<1 of the x axis, the reading f(x) differs from 
the true value y(*) because of the influence of neighbouring elements. Let the 


influence at the point x of an element dé at the point & be K(x, é) y (€) d&; normally 
K(x, €) will depend only on the distance |*— €|, and here we will assume that 


1—(*—€)? for |*—é|s1 
) for |w—&| 21. (1.38) 


Then the reading taken at the point x will be 


1 
y(*) deg s) ae Fr 


K(x, 8) =| 


Thus we have an integral equation for the required true distribution (x) in terms 
of the observed (measured) distribution /(¥). For this example we will take 


pz) = 


(1.36), (1.37) yield immediately the corresponding variational problem 
1 


1 ili il 
Jiua= > f f Kee dts) wld) axde + 3 | tear aL 
= =i 


4 42 
—1 -—1 


Taking account of the symmetry, we assume the two-term approximation 
u=a+tbx?, (41.39) 


and instead of first forming J, we form the expressions d]/da, 0J/0b directly; 
differentiation of the double integral with respect to a, for instance, yields 


1+ x? 


1 il 
SS K(%,) (2a + b(#* + &)) dxdé 
—-1-1 ee . : 
=2f PGC ea ataeg) i (7 5) 2 dg a b 
0 é-1 


We obtain for a and 6 the equations 
oy 2S ae 19 b nm 


- j 


0a 6 15 2 
oo . ee 734 <n 
0b AS) 60 iz 
with the solution 
a= 0:4428, 


b = —0:2164. 
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This parabolic approximation is quite crude, however; in Fig. V1/6 it is compared 
with the results obtained by the summation methods of § 1.2 with h=4 and h=i; 
these results show that the curve of 
the solution y(%) is bell-shaped, and 
it camnot therefore be followed 
closely by a parabola, which has no 
points of inflexion. 


II. A non-linear integral 
equation (already treated by 
collocation in § 1.6). 

There are various ways of 


— Ritz’s method a ' 

(2nd-degree polynomial) setting up a corresponding 

o Summation method h=F variational problem for the 
»  h=t equation 


1 


J Vx +E y2(6) dé =y(x); 


0 


ze 
Sass VI/6. Some asgmntte solutions of an scene one could, for example, multiply 
geneous integral Whip eetnrore Haare Ritz’s method the equa tion through by y (x), 

thereby bringing the integrand 
into the form given in Table VI/5, right-hand column, last row but 
one; we see from the left-hand column that this is generated by (4.35) 


from the function 
F=4)x+ Ey*(x) y2(Q). 
Here, however, it is somewhat simpler to write the integral equation as 
1 


f V%+2(6 dé =Yz(x) 


0 


by introducing z(x) = (x); then according to (1.33), (1.34), (1.36), 
(1.37) a corresponding variational expression reads 

So ee 1 
J(u] = ff Re +E u(x) u(S) dade —2 fub(x) dx. 
00 


0 


For the simple linear approximation u(x) =a+bx the necessary 
minimum conditions read 


11 1 
gam ff $ VR FE 2a + b(n +O} axdg — [ Ja+oxdx =o, 
00 0 


11 ; 

@ Pos iagcl fe —— 

a-ffe Vx + &{a(x +8) + 2bEx}dxdé — | xYa+bxdx=0. 
00 : 
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On evaluating the integrals we obtain the two non-linear equations 


aatpo=2 (jaro ya) 


patyd=5,(ja+o— Ya) — 24 (Vato — Ya), 


where 
(2/2 — 1) ~0-97515, 


(oa 


= 
5 
nar, 
B ~ a — 1) 053221, 
= © (\/2 + 1) » 0-28643, 
and these can easily be reduced to a single equation for the ratio c =b/a 


a+ fe a ve —1) 
Bye iVize S40 


this has the solution c= 1-8861, yielding a =0-4861, b =0-9168. Speci- 
men values of the corresponding approximate solution u are 
4 


ee age 


4 
| 06972 | 09719 | 1-1844 


u 
which agree well with the results of § 1.6. 
1.8. Integro-differential equations and variational problems 
Here we can be brief because of the similarity with the last section 


and with Ch. III, § 6.1. 
Suppose that the expression 


bb 
ul= Jf F(x,&,u(x),(E), u(x), u'(),...,. 0 (x), ul (E)) dxd E+ 
b n—1 
+ f G(E, w(&), w'(&),..., wl (E ae + 2 (a, u” (a) + (1.40) 
ae b, yw”) (b)) a S (a,, 0) (a) y”) (a) a b, gues () u) (b)) 


is to be minimized. F and G are given functions continuous in each 
of their arguments and with as many continuous partial derivatives as 
are given constants. 


are needed in the following; and a,, 0,, 4,,, b,, 
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Here we can prescribe certain boundary conditions 


U, [u (a), 0 (b), u'(a), w’(b), ..., w—" (a), «0 (6)] = y, 


(1.41) 
(4 =1,2; 0) Rees 


which we will assume to be linear in the boundary values specified. Let 
there exist a solution y(x) of this variational problem. Then the usual 
procedure of considering a one-parameter family of admissible func- 
tions u=—¥-+ en leads to the necessary condition 


= (F-Jly + en). fm 
bon (1.42) 


sie aCe n®) (x) +H 0M@)) dx db +f EG, n” (6) dE F 


y=0 a v=0 


for any function 7 satisfying the homogeneous boundary conditions 


U,[n]=0 (u=1,2,...,4), (1.43) 


where in (1.42) we have introduced the notation 


OF OF aG 
F, = Se A, =—_: G,= ? 1. 
+7 aul) (x) 7 aul) (&) aul”) oa 
n—1 
Y= > [a,™ (a) + 6,9” (6)] + 5 ayy (y) (a) g(a) + 
= a Fi | (1.45) 


+ y® (a) 9 (a)) + by (y™ () n™ (b) + y (b) n (b))]. 


Further, let a tilde embellishing a function symbol signify that x 
and & have been interchanged at every place where they occur in that 
function, so that, for example, 


F, =F, (E, x, (8), u(x), 0'(6), w(x), ..., (8), a (x)), 
and put 
ee ale E, — 2. 


Then by interchanging x and € in the single integral, and also in the 1m 
terms of the double integral, we can write (1.42) in the form 


= ff F(x) @ pdxdé +f Sx) G,dx+¥., (1.46) 
aa v=0 a@ »=0 


We can now transform it further by integration by parts. We have, 
for example, 


bb b bb b 
iol n(x )Oaxds = hil ih mas — fas = ®,d8)ds 


aa a a 
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and similarly transforming all other terms (integrating the term in 
n”) by parts v times), we obtain 


b b 
= fac} f(2.- = @, be ®, --)dE+(Go a Gy+ i Gy dant 


ax? 


b 
+ncof f(@- Zeta )a+(G- {atrZ eI + 


a 


+f [ (G:F e+ 5O,—--\dt(O—F Gt # a} + 


b b 
Hore tant ftr of fo.aeea,}] +y. 


a 


On account of the arbitrariness of y, the factor multiplying 7 (x) in 
the integral must vanish; this yields the integro-differential equation 


: Ld v nn 2 
ior 1)” ie ®,)aé + D(— 1! so (sama) =0; (1.48) 


The integral with respect to x therefore drops out of (1.47), leaving 
a sum which is linear and homogeneous in the boundary values 7 (a), 
n'(a), ..., 9 (a), 7 (b), '(0), ..., 9%" (6). In general, & of these 2 
boundary values can be expressed in terms of the remaining ones by 
means of the boundary conditions (1.43). These 2%—k remaining 
boundary values may be called ‘‘free boundary values’, and will be 
denoted in any order by 7, 7% ,---,%2n—,: If all boundary values of 7 
appearing in (1.47) are now expressed in terms of the free boundary 
values, the sum remaining in (1.47) assumes the form 

2n—k 


x ny W,ly] = 0. (1.49) 


Since the 7, may be chosen arbitrarily, we must have 
Wily] =0 (vy =4,2,...,2%—R). (1.50) 


These equations constitute 2n— further boundary conditions to be 
satisfied necessarily by the solution y of the variational problem. 
Thus y must satisfy the integro-differential equation (1.48), which 
in general is of the 27-th order, together with the 2” boundary conditions 
(1.41), (4.50). In general this determines y uniquely. 
The following two possibilities should be noted: that integrals over 
the fundamental interval can occur in the boundary conditions (1.50) 
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derived from (1.47), and that boundary values of y can appear in the 
integro-differential equation (1.48) if integration by parts is applied to 
the integral. 


Example. The vertical oscillations of a suspension bridge satisfy the integro- 
differential equation? 


l 
(Ely) Eek fy(é) dE=mu*y 


together with certain boundary conditions, which, if the bridge is assumed to be 
pinned at each end, read 
y(t) = (4) =0. 

Here, EI is the flexural rigidity of the stiffening girder, H the horizontal 
component of the tension in the cable, m the mass per unit length of the oscillating 
parts, m the frequency of the oscillations, y the deflection due to the oscillations, 
2/ the span and & a certain constant. 

For this problem a corresponding variational problem reads* 


i 
J(4) = f (Ew? + Hut motu) dx+h ( J u(g) a8)’ = extr. 
—l pas 


with respect to the domain of admissible functions u satisfying the essential 
boundary conditions «(+ 1) =0. 


1.9. Series solutions 


Integral equations frequently arise whose form suits them for 
treatment by a series expansion method of one kind or another — a 
power series or trigonometric series method, for example —, the appro- 
priate series to use depending on the particular form of the integral 
equation. For instance, trigonometric series are very effective for linear 
integral equations of the form (4.2) with “convolution-type kernels” 
i.e. integral equations of the form 


b 
y(x) = f(x) +AS K(x—€)y(E)dé, (4.54) 
a 
in which the kernel is a function only of the difference x—£, provided 
also that K is periodic with period 6 —a: 
A(x — €) = K(x —&E+6—a). 


We imagine the functions A(x), f(x) and v(x) to be expanded as 
trigonometric series written in complex form: 


= Aye ae ee ope 
Kae > hye "=a , {()= a he “baa 


vy=—0O y= — 00 


’ 


(1.52) 


' Ki6prEL, K., and H. Lie: Lotrechte Schwingungen von Hangebriicken. 
Ing.-Arch. 13, 211—266 (1942). 

* A numerical example can be found in L. Corzatz: Eigenwertaufgaben, 
PP. 244, 377. Leipzig 1949. 
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and insert these series into the integral equation (1.54); assuming their 
convergence to be sufficiently strong that they may be multiplied together 
and integrated term by term we obtain 


= tt = oo . ans 
Den araa Daemre Sy, fertoe tag, 
Now 


b KE = = 
[ éro-aag = 6b—a_ for eae 
0 for integral k +0, 


a 


so that the only non-zero terms in the double sum are those with u =», 


. vs 
and by equating coefficients of e"*t=a we find that 


Vy, —f, =A(d — a) Ry Vy 


or 


- ty 
v9 q1-lb=a (1.53) 


Thus, provided that the denominator in (1.53) does not vanish, i.e. 


provided that A is not one of the eigenvalues a we know the 


Fourier coefficients y, and hence also, from (1.52), the solution y(x). 
When the fundamental interval is infinite, we use FOURIER’S integral 
theorem instead of the Fourier expansions (1.52) (see textbooks on 
integral equations)?. 
For linear integral equations of the form (1.2) the solution y(x) is 
sometimes? expanded as a series of functions which are orthogonal over 


the fundamental interval, i.e. functions z,(%), 2)(),... with 
b 
0 for 7=&, 
fae R(t) ax = ‘. ae ag (1.54) 
The series 
y (*) = eh (x) (1.55) 


1 An application to the integro-differential equation 
+00 
y (x)= f K(|x—€l) (b(E) — e IV (6) ae 
—oo 


{for which boundary conditions are replaced by the condition that y shall be 
integrable in (— oo, oo)], which arises in the investigation of the effects of elasticity 
in railway track mountings, can be found in M. E. REISSNER: On the theory of 
beams resting on a yielding foundation. Proc. Nat. Acad. Sci., Wash. 23, 328 — 333 
(1937). 

2 Various series expansions are used by D. ENskoc: Eine allgemeine Methode 
zur Auflésung von linearen Integralgleichungen. Math. Z. 24, 670-683 (1926). 
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is inserted into the integral equation (1.2) and the resulting equation 


oO b co 
2 avee(x) —4f Yay K(x, €) (8) dé = 1 (2) 


multiplied by z,(x), then integrated over the fundamental interval <a, b>. 
Assuming that term-by-term integration is permissible (which has to be 
verified separately in individual cases), we obtain the following infinite 
system of equations for a countably infinite number of unknowns a;: 


8 — AD Mate = C4, Dyccxts (1.56) 
where 


bb 
wy == ff K(x, 8) 2;(x)m(E)dxdé, 7, a 2;(x)dx. (4.57) 
aa a 

This infinite system is usually solved approximately by retaining 
only the first # equations and solving them for the first unknowns 
a,...,4, with the remaining a,(r>) put equal to zero. The values 
so obtained may be called the #-th approximation and will be denoted 
by af’, ..., af); they are calculated from the finite system of equations 


p 
afis;— Ad rea = 7; (ee, Pe (1.58) 


For the corresponding eigenvalue problem, i.e. (1.2) with f(x) =0, 
we have 7; =0 and we calculate the p-th approximations . 1”, 1, ..., A! 
to the eigenvalues A, as the roots of the algebraic equation obtained by 
putting the determinant of (1.58) equal to zero?: 


S$, — Amy, = Ate ss — Am, | 
—Axe, Sg — Nias see — Avg, ithe (1.59) 


1 Léscu, F.: Zur praktischen Berechnung der Eigenwerte linearer Integral- 
gleichungen. Z. Angew. Math. Mech. 24, 35—41 (1944). Under the assumption 
that K(x, &) is continuous and can be expanded “ede as a series of the form 


= Sol zy(§) with g,(x = Ke 2, (&) dé, 


Léscu proves that the tend to the eigenvalues 4; of the integral equation 
in “position and order’’ and that when the eigenvalues of the integral equation 
are all simple, the suitably normalized approximating functions 


¥ al? zi (x) 

j=1 
converge uniformly in a<+<6b to the corresponding eigenfunction of the integral 
equation. Symmetry of the kernel is not assumed. 
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The method is also applicable to linear integro-differential equations 
of the form (4.3) with the boundary conditions (1.4). Here we use a 
set of functions 2)(x), 2, (%), 2,(x),... with zg(x) satisfying the inhomo- 
geneous boundary conditions (1.4) and the other 2z;(x) satisfying the 
corresponding homogeneous conditions: 


U, [20] =u eo 
U,[z;] =0 ee eee 
Inserting 


y = Zo a ee aE (4 .60) 


into the integro-differential equation (1.3), we obtain (again assuming 
that the various operations may be performed term by term) 


(ore) b oo 
day MUe] — AS Da K(x, €) NiO) 4E = 9 (2) 


b (1.61) 
= f(x) — M[zq(x)] +4 f K(x, &) N[zo(€)] 46. 
The constants a, could be determined approximately by one of the 
general methods of § 1.6 — collocation, for example — but we can also 
use a method allied to the method described above for the special case 
M(y]=N[y]=y. Let w,(x), w2(x),.-.. be a system of functions which 
is complete over the interval <a, b>. Then multiplication of (1.61) by 
w,(x) and integration over the interval <a, b> yields 


Dd (mz, — AN, n) % =; eA 2). 5) (1.62) 


where 


rigy = Sf Kx, £) (2) Nig @)] 4x a8, (1.63) 


aa 


r; ae w,(x) ax. 


Again we have [in (1.62)] an infinite system of equations for the 
unknowns 4; and can obtain approximate solutions as above by retaining 
only the first # equations and the first p unknowns. 

For the corresponding eigenvalue problem, in which f(x), Y,»20(%), 
p(x), 7; are all identically zero, it is to be recommended that the z,(x) 
and w;,(x) be so chosen that m;,=0 for j-Kk; then with A=4/x the 


496 VI. Integral and functional equations 


equation for the approximate eigenvalues reduces to the secular equation 


Ny4~—2#X#M, Nhe Mp | 
Me Nog — HMgq--- Noy = 0: 


This can be achieved, for example, by choosing the z, (x) as the eigen- 
functions of the eigenvalue problem 
M[z,] =A, U,[%] =0 
and putting 


1.10. Examples 


I. An inhomogeneous integro-differential equation. Consider the 
equation 


af 


with the boundary conditions 
y(0) =y(1) =0. 
For the series satisfying the boundary conditions we take 
co 
a) — 2a xh). 


For a two-parameter approximation we retain only the first two terms, 
putting a@,—0 for k=3; then insertion into the equation yields 


a, (—1—%)+a,(—3 x—3 x?) }+10f ale ple ae d&+1=0. (1.64) 
Here, suitable functions for on We (x) ATE Cie ASTI 19 . .)p 
thus one equation for 4@,, a, is Stomet by integrating (1.64) over the 
interval <0,1> and the other by first multiplying (1.64) by x, then 
integrating over <0,1>. Before writing these equations down, we 
evaluate wer the more complicated integrals which occur: 


(€ — &) dxd& : — 
off 1s = 7 (8+32In2—2 In 3) = 0-086 3630, 
"(= 8) dx dt &8) dx d& a lees my 
=[ ae =i(-4 8In2+91n 3] 0-127 2500, 
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aff Ei tetl = Hae ae +8In2—9In3) = 0-0394167, 


3) dxd 
Jum ff peared oe (-2 — 881n 2+ 81 In 3) = 0-0581774 


(a useful check on the order of magnitude of the value obtained in each 
case can be made by considering the range of values assumed by the 
integrand). 


The two equations for a, and a, read 


a (— 3+ 10Jy1) + a3(— $+ 10f,2) +1 =0, 
a (— § + 10Jo3) + a2(— $+ 10Jos) +4 
and have the solution 
a, = 2-7135, a= —0-59206. 
As an approximation for the mid-point value, for example, we obtain 
y (5) = 0-4563. 


II. A non-linear integral “ae For the integral equation 
[y(*) + ¥(€)}* 

dé=1, 

fess 1twe+é cae 


already considered in §§ 1.3, 1.5, it is expedient to move the origin to the centre 
of the fundamental interval before uae power series expansions; we introduce 
the new variables u= x — 34, v=&—4, z(u) =y(u+ 4), thus transforming the inte- 
gral equation into 


——-—-. dy = }, 
2+u+u8 
—3 
and then insert the power series 
4 1 u+u (4+ v)? 
A) Oat cae Ge, a ae pag eS are 
AG) SSG TO el aaa ra 7s asa s 


If only terms of at most the second degree in u and v after multiplying out the 
series in - integrand are retained, the integration yields 


az ai ie 1 
= fos + (2a,a, — a3) u + 5 + i + 2a)@, — ay a, | wer : 
By pile coefficients we obtain the three equations 
1 = 2a}, 


0 = 2a, 4, — a3, 
(6) ae ay a, + % 
ree 0 4 ool aes 


Collatz, Numerical treatment, 3rd edit., 2nd print. 32 
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with the solution 


and hence 


1 1 1 4 {47 y) 1 
ee, ee S EEE (EOP AE a Oe Oa 
feee| = (1+ aa 5M) yes (+ le az) 
For the positive solution, for example, we obtain the approximations 0-5192, 
0-7071, 0°8729 for y(0), y(4), y(1), respectively. 
If we had retained only the linear terms in the integrand, we would still have 
obtained a fairly useful approximation, namely 


1 1 e/a 1 
mvt [/S(t+ 54), yet VS(F4+ 5+). 


§2. Some special methods for linear integral equations 
2.1. Approximation of kernels by degenerate kernels 


The method to be described now relates to linear integral equations 
of the form (1.2) or to the more general case of linear integro-differential 
equations of the form (1.3) with the boundary conditions (1.4). 

In this method the kernel K(x, &) is approximated by kernels A,, (x, & 
of the form 

Kis, 6) — = 5 Ass x) B;(é). (2.4) 
= 

A kernel which can be written in this way as a finite sum of func- 
tions in which the variables x and & can be separated, i.e. confined to 
separate factors A,;(x) and B,(&), is called a “‘degenerate kernel’. Any 
continuous kernel may be SOprORnaed to any degree of accuracy by 
a degenerate kernel. In practice one often uses polynomials or trigono- 
metric functions for the functions A, (x), B,;(£). A degenerate approxima- 
tion K,,(x,&) to a kernel A(x, &) can also be determined! from the 
equation 

K,(x,8) K(x,8) K(x.) Klas) | 
HG( X16) la ey) K (sa Eh) eye be "|= (2.2) 
| 


K(x, ) K(x, €1) K(x aya K(x CaaS, :) 
where the x; and &; are sclected points of the fundamental interval; the 
degenerate kernel K,, then coincides with the given kernel A along the 
2n lines x =x, and  =§;: 
K,,(*, &) = K(x%,&) and K,(x,;,6) =K(x,,€) for 7 =1,2,...,n 


1 BaTeMAN, H,: On the numerical solution of linear integral equations. Proc. 
Roy. Soc. Lond., Ser. A 100, 441 —449 (1922). 
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For a degenerate kernel the solution of the integro-differential equa- 
tion (1.3) with the boundary conditions (4.4) may be reduced to the 
solution of a set of ordinary boundary-value problems and of a system 
of linear equations. 

We therefore replace the kernel K(x, &) in the integro-differential 
equation (1.3) by the degenerate approximation K,,(x,é). Then by 
interchanging the order of the summation and integration, and taking 
the functions A;(x) outside of the integral sign, we obtain 


MUy 2] = 12) + AD 4,6), (23) 


where 


b 
J B;(€) N[y(é)] dé. (2.4) 
Now let z(x) be the solution of the boundary-value problem 


Miy()]=f(%), Ulyl=yue  (¢ =1,2,...,m) 


and z,(x) (for k=1,...,) the solution of the boundary-value problem 


M[y(x)]=A,(*), U,[y]=0 (u=1,2,...,m) 


(we assume that these +1 boundary-value problems possess unique 
solutions) ; then the boundary-value problem (2.3), (1.4) has the solution 


y(2) =22) +AD ole), (25) 


We now insert this expression for y into (2.4), and obtain a system 
of equations for the ¢,: 


b ” b 


C; aa eile &) N[z(é ab +A Xe, S Bi(é) N[z,(€)] dé. 


If we introduce the Kronecker symbol 


J, GO for g=-k, 
he y1 for jie 


and define ; 


aja J BE) I a(Eide, =f BlENEE\dx, (2.6) 


a 


these equations can be written more compactly as 


a 
Ms 


(0;4 — Aa;z) C, = 7; S42, eh). (2.7) 


32” 
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Thus the c, can be calculated provided that the determinant 
does not vanish, and with these c, values (2.5) gives the solution of the 


integro-differential equation with the degenerate kernel (2.1). 


If we have a completely homogeneous problem with /(x) =0, y,=0 
(an eigenvalue problem), then z(x) =0 and 7,=0, and the zeros of the 
determinant provide approximations A, for the eigenvalues A;. 


If the degenerate kernel K,,(x, &) defined by (2.2) is used, the solution 
of the integral equation (1.2) of the second kind can be expressed in 
the form? 


b 
y(x) =f(*) +4 f G(x, &, a) f(€) dé, 
where the solving kernel G(x, &, A) is to be determined from the equation 


G(x,é,a) K(x,6,) K@gé)... Meee 
K(%,6) Ai Ais me Ar, 


K(%q, 4) Ani Ane 2 eee 
with 


Aj, = K(x;,6)) — AJ K(x;,t) Kt, &) dt. 


2.2, Example 
For the problem 


il 

“t i d 

+ yr +10 [2S +1=0, 90) =y(t)=0, (2.9) 
i] 


considered in § 1.10, let the kernel A(x, &) ae be approximated 


first of all quite crudely by a constant A; the solution (x) of the 
approximate integro-differential equation can then be given in closed 
form. The equation reads 


1 
n’=—2— with C=—2—204 fn(é)aé 
0 


A+ 
and can be integrated immediately; using the boundary conditions 
7 (0) = (1) =0, we obtain 

yn =C((1+ x) In(4+%) —2x1n2]. 


1 Bateman, H.: (see last footnote) p. 443. 
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To determine C we calculate 
fl d& = C(In2 — 4) = —C x0-056853 = — Co, say, 
~ this value for the integral into the equation defining C and find 
at 


2 —2 
= yy : 
204A 6-1 as 7d 


If we take A =4 as being a reasonable average value for the kernel, 


we have C = — 4.6353, and hence (x) is known; in particular, n (4) 

= 0:3938. 
Now let ximate the kernel K(x, £) = 1 , 
w let us approximate the kernel A(x, &) the EE More accu 


rately by using a linear function A+B(x+é). The corresponding 
approximate solution 7(x) is now to be determined from 
1 
(1+ x) 4" = —2—20f [A+ B(x + §)]n(6)d& =C + D(1 +2), 
(0) =n (1) =0, 
and again we have a problem which can be solved in closed form: 


x2— x 
2, 


yn =C[(4+x) In(it+-x) —2%*In2]+D 
To determine C and D we calculate 


1 


1 
fn@ae=—co—tpv, feneag=-tc-tn 
0 


(with 6 as defined above) and insert these values in the equation defining 
C and D; then by equating coefficients (of powers of x) we obtain two 
linear equations for C and D: 


(41 —20A6— $B)C+(1—§A—SB)D= -—2, 
= one. 41 —SB)D= 0. 

The values of C and D depend on the choice of values for A and B. 
Suitable values for A and /& could be determined by the method of 
least squares, but here we use values (A =0:3, a a which were 
obtained simply by means of a graph; they give C = — 7.6386, D = 1-6035 
and 7 (4) =0-4485. 

Naturally one could use still more accurate approximations for the 
kernel K(x, é). 
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2.3. The iteration method for eigenvalue problems 


The theory of the method of successive approximations, or iteration 
method, of Ch. III, § 8.3 applies also to the linear homogeneous integral 
equation 


y(x) =A f K(x, &) y(&) dé (2.40) 


with symmetric kernel K(x, ) when this kernel is square-integrable and 
continuous in the mean?. Starting from an arbitrarily chosen, continuous 
function F(x), one determines further functions F,(x) from the iteration 
formula (1.20) and calculates the corresponding Schwarz constants 4,, 
and quotients u,, defined by (1.21), (1.22). One can then make use of 
the results stated below. 

We arrange the eigenvalues of (2.10) in order of increasing absolute 
value, treating each multiple eigenvalue, say of multiplicity m, as a set 
of m coincident eigenvalues: 


O0S|4|S|A|S|4|S---, 


and for the following assume that 0<|A,|<|A,|. 
Then we may state: 


4. If, besides being symmetric, square-integrable and continuous in the 
mean, the kernel ts ‘‘posttive definite’, 1.e. the eigenvalues are all positive, 
then the u,, decrease monotonically : 


Mbq@2 ge 2A, > 0, (2.14) 
and 
OS pps, 2 (2.42) 
2 
—3-—1 
Paty 


where 1, is a lower limit for the second eigenvalue, but 1s greater than u,.4! 
Ag= ly > bn4r- 


2. In the more general cases for which the condition of positive defi- 
niteness of the kernel 1s relaxed, the tt, need not form a monotonic sequence; 


1 That is when the integrals 
[K(x,é)ds, Jf K*(xé)dz, ff K(xé)@ee. ff Keene 
over the fundamental interval all exist and are bounded (square-integrability) and 
li K — K(s ei 
Jim f (K(x, 8) — K(m,)]*4é = 0 


(continuity in the mean); both of these conditions are satisfied when A(x, &) is 
continuous. See G. HAMEL: Integralgleichungen, 2nd ed., p. 68. Berlin 1949. 
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now, however, the products fy, 42, decrease monotonically : 


Hy Ma= Ms a= Mp e= SA ZO, (2.13) 


and the corresponding limits for the first eigenvalue! take the form 


C= iin aas na =e Panaalan— Man+iMante ; (2.14) 
2 


Pen+tibante 
where l, 1s a number such that 


Ae 213 > Mansi tensa 


3. The enclosure theorem also holds?: If the function 


Fy (#) 
G(x) = = , 
(x) = #8 (2.18) 
lies between finite limits Gy, and Gpa, and does not change sign in the 
fundamental interval, then Gmi, and Gpax enclose at least one eigenvalue 
Ay of (240): 
Gris = ApS Gnas (2.16) 


Sometimes a suitable value for /, or a direct estimate for A, can be 
obtained from the relation? 


mS bb 
oe K(x, £)}2}dxd& =k; 
La fy (x, é) Pax 


a 


for example, we can deduce that 


1 4 : ‘yi 
aE = k fe Ry’ es As Be ( “al . 
Occasionally one also uses the “‘iterated kernels’, in terms of which the 
above relation and allied results can be expressed; these “‘iterated 
kernels” are defined in § 3.1, where another use for them is described. 


The various modifications to the iteration method which were 
described in Ch. III, §§ 8.9, 8.10 can be carried over immediately to 
integral equations; in the literature, in fact, they are often established 
for integral equations first. 


1 Similar results for the higher eigenvalues and other generalizations are given 
by L. Cottatz: Math. Z. 46, 692—708 (1940), and R. Icttscu: Math. Ann. 118, 
263—275 (1941). 

2 Cottatz, L.: Math. Z. 47, 395—398 (1941). 

3 See, for instance, G. HAMEL: Integralgleichungen, 2nd ed., p. 68. Berlin 1949. 
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§3. Singular integral equations 


Applied problems frequently lead to integral and integro-differential 
equations for which the fundamental region is infinite or for which the 
kernel K(x, &) for equations of the form (1.2), (1.3) is unbounded. A 
numerical treatment of such singular equations must, of course, take 
into account the nature of the singularity, but so many different kinds 
of situation can arise that a unified description seems hardly possible; 
it must suffice here to select a few typical cases and use them to illustrate 
the application of some of the methods which have been used hitherto. 

Two of the most frequently occurring types of singular kernel K(x, &) 
can be written in the forms 


A(x, &)_ 
(Fey 


where H(x, &) is continuous in the fundamental region a<(x,&)<b. 


A(x, &) In|x — é|, 


3.1. Smoothing of the kernel 


For an integral equation of the form (1.2) a ‘‘smoother’’ kernel can 
be obtained by utilizing the smoothing property of integration in the 
following way1. We multiply the equation by K(v, x) and integrate with 
respect to x over the fundamental interval, then make use of the original 
equation to obtain 


b 
dori) SU x) y(x) ax 
bb 


b 
=Aff K(v, x) K(x, &) y(6)dxdi+ f Kv, x) f(x) dx; 


this also is an integral equation of the form (1.2), and can be written 


b 


y (v) = A? f Ky(v, €) y(é) dé + fa(v), (3.4) 
where 
b b 
Kale, &) = { Kaa) MiGet) dix, jee) == f (ujetod [ A (open) | (ois (22) 


In general the new kernel A, will be ‘‘smoother’”’ than A. In parti- 
cular, for a singular symmetric kernel of the form 


. A(x, &) 
K(@; 2) na (3.3) 
(¥—) 
1 See G. HaMEL: Integralgleichungen, 2nd ed., p. 140. Berlin 1949; or P. MorsE 
and H. FEsHBacH: Methods of theoretical physics, Part I, p. 922. New York- 
Toronto-London: McGraw-Hill 1953. 
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with 0~%2% the new kernel K, will no longer be singular. For the 
cas: 3-241, Ky will still be singular, but we can repeat the process 
on equation (3.1) and so on; after a finite number of such “smoothing 
steps’ we will have a kernel K, which is no longer singular. These 
kernels K,, K,,... are known as “iterated kernels’’. 

It should be noted that for the case with x =1 in (3.3) this smoothing 
process does not help, for the iterated kernels are again of the form (3.3). 
This important case will be dealt with in greater detail in § 3.2. 


3.2. Singular equations with Cauchy-type integrals 


A number of applied problems give rise to singular integral and 
integro-differential equations of the first and second kinds of the forms 
(the integral notation will be explained later) 


b 
a Ae) NL y(6)] dé = f(x) (3.4) 
and 
b 
yl) — Ag 2D NLy (6) dé =f(), (3.5) 


respectively?, where H(x, é) and /(x) are given continuous functions and 
Niy) is a linear differential expression in y of the m-th order. In the 
simplest case n= we have an equation of the form 


b 
ag 2G078) dé =t(2). 


An integral of the type considered here, usually known as a Cauchy 
integral, is improper and in general does not converge. In order to 
attach a meaning to it, we define its Cauchy principal value, distinguished 
by a C superimposed on the integral sign, as the limit 


provided that this limit exists. This is the value to be understood in 
the above equations. 

The difficulties which attend the solution of integral equations with 
these “Cauchy kernels” can often be surmounted by making use of 
certain singular integrals whose Cauchy principal values are known; the 
formulae (3.8), (3.15) below, for example, are used to this end. 

4 For the one-dimenstonal singular Fredholm integral equation with Cauchy- 


type kernel a cornplete theory has been given by N. J. MUSKHELISHVILI: Singular 
integral equations, 447 pp. Groningen 1953. 
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Consider the integral equation 


1 f£ y(6)de _ 
aa «Be = f(x). (3.6) 


—a 


First we transform it by the introduction of the new variables 


%=—acosg, §=—acosy 
into 
4 - y(—acosy) siny we 2 
oe cee "TN a COS Y) . (3-7) 
0 


If we now assume for the function y(— a cosy) sin y =g (wp) appear- 
ing in the numerator of the integrand an expansion of the form 


g(y) =y(—acosy) siny = $4) + Dib, cosny, 
n=1 


we can evaluate the integral in (3.7) by using the formula! 


4 
cosny __ _ sinnp = : ; 


(3.7) then becomes 


|e 


2 ee (3.9) 
n=1 


sin p 
We now assume that the function /(— a4 cos ¢) sin g may be expanded 
as a uniformly convergent Fourier series of the form 


{(—acosg)sing=—})/b,sinng (0<p<z); (3.10) 
n=1 


the b, (except by) are thereby determined, and in 


yg) = T= Uae a (3.11) 


where the cos” yw can be expressed in known fashion as polynomials 
in cos y (and hence in &), we have a family of solutions of the integral 
equation (3.6). We note that the constant 6, can be chosen arbitrarily 
and that the solution y(é) can become infinite like (a2— &)—4 at the 
end-points = +a. 


1 See, for example, G. HAMEL: Integralgleichungen, 2nd ed., p. 145. Berlin 1949. 
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Other singular integral equations, such as 


+a 


¢ 20S =1(9), (3.12) 


Coat 


for example, may be solved in a similar way}. 


On account of its importance in the theory of conformal transforma- 
tions, we will consider one more particular integral equation, namely 


2x 
1 b— 
19) =— 35 F 9 (0) cot “SP ao. (3.13) 
0 
If we substitute the Fourier series 
vo) = 5 %+> (a, cosn?- b, sinn B) (3.14) 
eat L 


for y(#) in the integral and use the formulae 


2n 

¢ cos mB cot me d} = — 2xsinny 

0 = 

2x (n =0,1,2,...), (3.45) 
¢ sin nd cot Hee a} = 2ncosny 


the integral equation (3.13) becomes 
oO 
H(y) => (a, sinn py — 6, cosn¢). (3.16) 
n=1 
If we assume that the given function f(g) may be expanded as a 


uniformly convergent Fourier series of the form (3.16) — this implies 
in particular that /(~) must satisfy the condition 


27 

ne 
—, then the unknowns a, and 6, (except a) are determined immediately 
by Fourier analysis of f(y). With these values in (3.14) we again obtain 
solutions y(#) in which a constant a) may be chosen arbitrarily. With 


the aid of numerical tables and formulae for trigonometric interpolation 


1 HameEL, G.: Integralgleichungen, 2nd ed., p. 148. Berlin 1949. 
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WitticH reduces this solution! to a form suitable for numerical 
evaluation. 

For singular integral equations which cannot be solved in closed form 
or by series expansions one tries to remove the singularity by some 
means or other in order that a quadrature formula may be used to 
evaluate the integral. A device which is often used for this purpose 
with kernels of Cauchy type is the following?. Consider the Cauchy 
integral 


b 
I(x) =¢ Le ae 


and assume that /(x, &) possesses a continuous derivative with respect 
to &. When x lies nearer a than b, say, so thata<x<b,h=x—a<b—x, 
we can write 


J=Haht+h, 


where 
£3 ath 
n= f Hebaes f eas 


and 


g § 


a 


x+h b 
— { f(%8)—fl% 2*—-6) f(x, €) 
| x— SE Nees 
4 x+ 


1 THEODORSEN, T., and J. E. Garrick: General potential theory. Nat. Adv. 
Comm. Aeronaut. Rep. Nr. 452 (1933) 1—35. Practical methods for conformal 
transformation are not dealt with in the present book because the subject lies at 
the very edge of the field with which the book is concerned; however, we can at 
least give a selection of references: TREFFTz, E.: Eine neue Methode zur Lésung 
der Randwertaufgabe partieller Differentialgleichungen. Math. Ann. 79 (1019). — 
Frank, Pu., and R. v. Misses: Differential- und Integralgleichungen der Mechanik 
und Physik, Vol. I, pp. 729—734. Brunswick 1930. — HEINHOLD, J.: Ein Schmie- 
gungsverfahren der konformen Abbildung. S.-B. Bayer. Akad. Wiss., Math.-nat. 
KI. 1948, 203—222 (where further literature is mentioned), also Z. Angew. Math. 
Mech. 30, 286—287 (1950). — Witticn, H.: Konforme Abbildung einfach zusam- 
menhangender Gebiete. Z. Angew. Math. Mech. 25/27, 131—132 (1947). — 
Léscu, F.: Auftrieb und Moment eines unsymmetrischen Doppelfligels. Luftf.- 
Forschg. 17, 22—31 (1940) (doubly-connected region). — Wutticu, H.: Bemer- 
kungen zur Druckverteilungsrechnung nach THEODORSEN-GARRICK. Jb. dtsch. 
Luftf.-Forschung 1941. — WarscHawsk1, S.E.: Recent results in numerical 
methods of conformal mapping. Proc. Symp. Appl. Math. VI, pp. 219—250. 
New York-Toronto-London 1956. — Experiments in the computation of conformal 
maps (edited by JoHn Topp). Nat. Bur. Stand., Appl. Math. Ser. 42, 61 pp. 
(1955). — Kanrorovicu, L. V., and V. 1. Krytov: Naherungsmethoden der Héhe- 
ren Analysis, pp. 330— 508. Berlin 1956. 

? A clear graphical explanation of the device and an application to a technical 
problem can be found in C. WeBEeR: Randverformung der Halbebene durch eine 
Normalbelastung, ,,Ein Ei des Kolumbus?". Z. Angew. Math. Mech. 30, 240—242 
(1950). 
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Now the integrals in J, combine to form one integral over the interval 
as&S2x-—a with an integrand whose numerator is symmetric and 
denominator antisymmetric about the mid-point =; hence, by the 
definition of the Cauchy principal value, J,=0. The evaluation of j, 
presents no difficulties since the two integrands now remain bounded, 
the limit 

lim 118) 1s, 24 = 5) (2 

zee ae : ag te 
existing by virtue of the assumption that f(x, &) is differentiable with 
respect to . 


Example. For the integral equation 
1 
ey eA 
Qn ¢ E—-x a [>| 
=A 


(3.40) requires that the function |cos g| sin p be expanded as a Fourier 
sine series: nes 
—2|cos y| sing = 2) bd, sinn 9; 
n=1 
by the usual rules of Fourier analysis we obtain 
= Sa ge z arn = evojpe 
Bay =0, 534-1 = (— 1) more Oreo (k =1, 2,...) 
From (3.11) it follows that 
oo 
1 1 
Seb, tee 0, cos my), where § = — cosy, 
y) = Te ete 
is a solution of the integral equation. The constant by is arbitrary and 
(4 — &)—4 must be a solution of the corresponding homogeneous equation. 
If we omit the arbitrary multiples of this function which may be added 
to any solution, we are left with the particular solution 


-_ 8 / cosp cos3p , cossy  cos7p . __,,, 
8 1 

ag wey. 
m Y1— & F 


The sum function of this Fourier series, which we have denoted by 
g, may be given in closed form?. If, however, graphical accuracy will 
suffice, one can quickly plot a few terms of the Fourier series to obtain 


1 By putting eiV=z, cosnp=rez” and summing the power series which 
results, one can show that 


‘ % y \) 
gly) = — 222 (1+ sinyintan (F — 3) for Oosys 


tla 
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a graph of g against y, transfer this graph onto a different abscissa 
scale to represent g as a function of &, then scale up the ordinate 
values in the appropriate manner to obtain finally a graph of y(&) 
against & (see Fig. VI/7). 


Fig. VI/7. Graphical evaluation of a Fourier series solution of a singular integral equation 


3.3. Closed-form solutions 


Some singular integral equations may be solved in closed form with 
the aid of inversion formulae!. Several examples of such formulae are 
listed in Table VI/6, in which for simplicity f(x), say, is regarded as a 


Table VI/6. Inversion formulae for some well-known singular integral equations 


Integral equation Solution 


i()= | ¢ (1+ cot $a) easel vie) = og (14 cot} wa) saree 


; 2a 


f(x) = |/2 f costa) neo ae 7) = |= f coscran ten as 
0 | 0 
i (€) dé | 1d f f(x)dx 
ix)= | 2S ge. (ee 
ie sie yé-—* 
1 1 —_ 
a — : a2 e 
jeans TPayg) 2g (OV ax [y(a)ax 
= | —1 —1 


1 See, for example, W. Macnus and F. OBERHETTINGER: Formeln und Sitze 
fiir die speziellen Funktionen der mathematischen Physik, 2nd ed., p. 186. Berlin 
1948. 
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given continuous function; actually, continuity may be replaced by a 
weaker condition, but for this and other details we must refer the reader 
to the literature. 


3.4. Approximation of the kernel by degenerate kernels 


The method of § 2.1 can also be applied to equations with singular 
kernels if these kernels have known expansions in terms of their eigen- 
functions, for we can then truncate these expansions to obtain degenerate 
approximations to the given singular kernels. 


Thus, for example, the kernel 
K(y, yp) =In|cos g — cosy}, 


with a logarithmic singularity, has the expansion 


K(9, y) —- y ad 
n=0 c 


with eigenfunctions y,(g) given by 


ee Sa: = 
yo 9n(9) = |/2 008 » g = 12,5.) 


(these form an orthonormal system) and eigenvalues 4, by 


poe, A=——  (n =1,2)..,) 


ain2’ 1 


For PRANDTL’S circulation equation 


| ar dy’ 
a; (¥) at 4nv Jy y—y’ 


2 


(an explanation of the notation can be found in the literature'), which 


1 The following is only a short selection from the extensive literature on the 
subject: K. ScHrOpER: Uber die Prandtlsche Integro-Differentialgleichung der 
Tragfliigeltheorie. S.-B. Preuss. Akad. Wiss., Math.-nat. Kl. 16, 1—35 (1939). — 


a 

‘ thee ff dé 

SOHNGEN, H.: Die Lésungen der Integralgleichung g () = _ ih 
—a 

Anwendung in der Tragfliigeltheorie. Math. Z. 45, 245 —264 (1939). — MuLTHoppP, 
H.: Die Berechnung der Auftriebsverteilung von Tragfliigeln. Luftf.-Forschg. 15, 
153—169 (1938). — ScHwaBE, M.: Luftf.-Forschg. 15, 170—180 (1938), gives a 
computing scheme for MuLTHoPP’s method for the calculation of the lift distribu- 


tion over a wing. 


und deren 
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occurs in wing theory, this method of replacing the kernel by a degenerate 
kernel leads to a system of equations first derived by MuLTHOPP, but 
in a different way!. 


§4. Volterra integral equations 


4.1. Preliminary remarks 


If the upper limit in the integral equation is variable, it is called a 
Volterra integral equation; in particular, 


f(x) =f K(x,£) y(é) dé (4.4) 


is called a Volterra integral equation of the first kind and 


y(x) =H(x) +f K(x, 8) 9(Q) a8 (4.2) 


a Volterra integral equation of the second kind. y(x) is to be determined 
for given functions /(x) and K(x, &) which we assume to be continuous 
for aSx<b and aXx<é&<b, respectively. 

In general, differentiation with respect to x transforms a Volterra 
integral equation of the first kind into one of the second kind; thus we 
obtain 


* aK (x, 8) 
Ox 


P(x) = K(x, x) y(x) + 


a 


y (8) dé, 


which can be written in the form (4.2) by dividing through by A(x, x): 


__" fees OE. 
1 K(x,x) i ax K(x, x) ag. (4.3) 
For this transformation to be legitimate we must assume that f(x) and 
K(x, €) are differentiable with respect to x and that A(x, x) 0. 


Under the assumptions of continuity made above, it may be shown 
that the Volterra integral equation of the second kind (4.2) always 
possesses one and only one continuous solution y(x)®. 


1 That MULTHOPP’s equations could be derived by using the principle mentioned 
here was recognized by K. JAECKEL: Praktische Auswertung singularer Integral- 
gleichungen. Lecture. Hannover 1949. 

7 See, for example, G. HAMEL: Integralgleichungen, 2nd ed., Pp: 52Metmseq! 
Berlin 1949. 
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Volterra integral equations which occur in applications often have kernels of 
convolution type, i.e. kernels which are functions of the difference 6= x —& alone: 
K(x, €) = K(x — ) = K(6). For such cases WHITTAKER! recommends that K (d) be 
approximated by a sum of kernel functions of similar form, i.e. of convolution 
type, but for which the integral equation can be solved in closed form. He exhibits 
several classes of such kernel functions. Here we mention only the class of kernels 


n 
of the form K(6) = >} dye?’ »°; for this kernel the solution of (4.2) (with a= 0) reads 
v=1 


y (2) = f(x) + f R(x —s) f(s)ds, 


where 
5 
K(x) =) (xy — Py) (ay — Pg) --- (%y — Pn) he 
Lt (hy — 0%) (ty — 04g)... (ty — Ly 3) (ty — Oy 4.3) «(Hy — Op) 
the a1, %2,..., % being the roots (assumed to be distinct) of the equation 
n 

D2 a i 
rear ~— py 


4.2. Step-by-step numerical solution 


Perhaps the most obvious method for the numerical solution of (4.2) 
is to replace the integral by a finite sum2. Let 


%=F=atth, y,=y(%), K=t(*), Ky=K(x;,&), (4.4) 


where / is a suitably chosen pivotal interval, and let Y, be an approxi- 
mation to be calculated for y;. Then from (4.2) it follows first of all 
that fy>=vp= Yo. For x =x, we evaluate the integral by the trapezium 
rule (the use of a more accurate quadrature formula is described in 
§ 4.3) and obtain the equation 


h 
Mi=At+ => (io %o + Ki Mi); 
thus we can calculate 


h 
h+ > Ke% 


(ta ao = (a 
h 
1— 9) Ky 


(4.5) 


1 WHITTAKER, E. T.: On the numerical solution of integral equations. Proc. 
Roy. Soc. Lond., Ser. A 94, 367—383 (1918). 

2Cf. J. R. Carson: Electrical circuit theory and the operational calculus, 
p. 145. New York: McGraw-Hill 1926. A similar method is used by A. Huprr: 
Eine Naherungsmethode zur Auflésung Volterrascher Integralgleichungen. Mh. 
Math. Phys. 47, 240—246 (1939); he replaces the function to be determined by 
piecewise-linear functions. Cf. also V. I. KryLov: Application of the Euler-Laplace 
formula to the approximate solution of integral equations of Volterra type. Trudy 
Mat. Inst. Steklov 28, 33—72 (1949) [Russian; reviewed in Zbl. Math. 41, 79 
(1952), also in Math. Rev. 12, 540 (1951)]. 


Collatz, Numerical treatment, 3rd edit., 2nd print. 33 
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For x =*,, we obtain in the same way the equation 
YF =f +4 (KyoYo+ Fg hes 2K 2 Yo eal GA SO Har) icc ed Oy x), 


and hence we can calculate 


n—1 
Y= —L— [fet 3 Kae thd K,.¥,) (4.6) 
{ =e i=l 
22 


in terms of the values Y,, Y¥;, ..., Y,—; calculated in the previous steps. 


Example. Linear transmission systems. Suppose that we have an 
arbitrary linear transmission system (whose physical nature we may 
leave unspecified), i.e. we imagine a system with an input and output 
for which the associated input and output quantities (functions of time) 
are related by a linear transformation. If we denote the input function 
by y(é) and the output function by S(t), this transformation may be 
expressed in the form! 


S) =y)40) — f ¥@) FeAu—Has (4.7) 
or, equivalently, 


S() =< f yt HAW aE: (4.8) 


here A(é) is the response to a unit step function, i.e. the output S(f) 
produced when y(¢) =0 for ¢<0 and y(#)=1 for ¢>0. The physical 
nature of the input and output quantities 
may or may not be the same; ina mechanical 
system, for example, the input might be a 
force and the output a displacement, and in 
an electrical system both quantities might be 
currents. 

0 7 2 =e For our example we will consider a 
Fig. VI/8. Response of a sluggish sluggish measuring instrument whose 
measuring instrument to a unit step . : . 4 

function input immediate response to a unit step function 

input is a deflection of only a half a 

unit, which then gradually increases to the correct unit deflection 
according to the law (see Fig. V1/8) 


A(t) =1+ (4.9) 


The question arises what is the time distribution of the quantity to 
be measured y(¢) if a specific time distribution of the reading S(t) has 


1See, for example, K. W.WaGNER: Operatorenrechnung, 2nd ed., p. 14. 
Leipzig 1950. 


e-t?—{ 
Dt 
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been recorded. Equation (4.7) is then a Volterra integral equation of 
the second kind for y(t). We will consider the case S(t) =1; thus we 
ask how the quantity to be measured y(t) must vary in order that the 
deflection may remain constant. 


Integration of (4.8) from 0 to ¢ yields 


a f y(t—£)A(é) dé; (4.40) 


this is a Volterra integral equation of the first kind in a form which 
can be obtained by a trivial change in the variable of integration for 


Table VI/7. Step-by-step solution of a Volterra integral equation 


Calculation with h=0-2 Calculation with h=0-1 


Approximation Y Error Approximation Y Error 
ce) 0:5 2 
O14 0°5241870 1°903 252 
0-2 0-5468270 1°-812692 1°822052 +0-:0005 
0-3 0-568 0303 1:744497 
0-4 0-587 9000 1-683 48 1°680 822 +0-0009 
0:5 0-606 5307 41°618255 
0:6 0:624 0097 1°55894 1°56844 +0:-0012 
0-7 0-6404181 1°51757 
0:8  0°655 8306 1-483 37 + 0-006 1°47877 +0:-0015 
0-9 0°6703165 1:43700 
1 0-683 9397 1°3963 — 0-009 1:40698 +0-0018 


any kernel of convolution type. If A,,= A(nh) and Y,, is the approxima- 
tion for y(nh), the equation derived by using the trapezium rule to 
evaluate the integral reads 


t, =nh = (4,4 2Y Anat 2g Ages + ae 2 at Yeo) 


hence 


we 


fia : 
1 = 
=|, (2"—-%4,-25 ¥A,-,)- (4.114) 


vy=1 

The values obtained by means of this formula with the two different 
pivotal intervals h =0-2 and A=0-1 are given in Table VI/7. Better 
values can be obtained by using a more accurate quadrature formula — 
Srmpson’s rule, for example, cf. § 4.3. 

a3" 
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4.3. Method of successive approximations (iteration method) 


Starting from a continuous function y)(x) we construct a sequence 
of functions! y,,(x) according to the iteration formula 


Yeaslt) =H) +S Ke 8) yelQ dE — (# =0,4,2-.). (4-12) 


Under the continuity assumptions made in § 4.1, the sequence converges 
uniformly to the solution y(x) of (4.2) in every finite interval <a, b*» 
with b*<b. If we denote pivotal values of y,(x) by 

Yinyk = Yn (Xx) 
and evaluate the integral by Srmpson’s rule, the iteration formula (4.12) 
reads 


h 
Yonty),2¢= haat > (Ken o¥nyot 4Ken,1 ¥ny1 + 
+ 2Kop,2¥ny2t 4Kor,3Vinys + 2KeraVnye too + (4.13) 


+ Kop on Vinyer) (oak, Oh ease rial 0 gs [Per eee 
With this formula we can calculate the values y,,.,), for even 1, but 
for the next cycle of the iteration we also need the values for odd +; 
these can be obtained by interpolating between the “‘even’’ values, say 
by putting a parabola through three consecutive points: 


Vin) =} (3 Yn), y—1 =e 6 Yn), v+17 Yen), »+3) (4.14) 
or, rather more accurately, by putting a cubic through four consecutive 
points: 


Yon). = a (5 Yenyo +15 Ynya— 5Mnya t Vemye) » (4.45) 


4 
Yon = Fe (— Yon, x3 + IVem, va + IH, 241 — Yo, v48) 1 (4.46) 
(1 = Bh Sey, alle 


If the solution is taken as far as the point + = x,,, the value ¥(,) 95-1, 
must, of course, be calculated from the formula corresponding to (4.15) 
and not from (4.16). 


Example. We consider the same problem as in § 4.2, i.e. the problem (4.7), 
(4.9) concerning a sluggish measuring instrument. With S(t) =1, -4(0) =} and 
A’(t)=442[1 —(1+12)e—*] the iteration formula (4.12) reads 


1 
Yntr@) = 2—2F yn(G)AE— £8) a8. (4.17) 


For the calculation implied by (4.13) it is convenient to make a separate table 
of the various multiples of the pivotal values of A’(t) which will actually be needed. 
These are reproduced in Table VI/8 for the chosen pivotal interval h= 0-1. 


1 An application can be found in K. ZoLLER: Die Entzerrung bei linearen 
physikalischen Systemen. Ing.-Arch. 15, 1—18 (1944). 


4.3. Method of successive approximations (iteration method) 


Table V1/8. Multiples of A’(t) needed for Simpson’s rule 


a 


0 0-25 

O-1 0°233 9420 0:935 7680 
0-2 0-2190388 0°4380775 

0-3. | 0:2052018 0-8208070 
0-4 | 0:1923498 | 0:3846996 

0-5 | 01804080 0-721 6321 
06 | 0:1693075 | 0-3386149 

0-7 0:158 9847 0:6359387 
0-8 | 0-1493812 | 0:2987623 

0-9 | 0:1404430 0-5617720 
4 | 0-4321206 
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| |  4:90327| 1-90570 4:905678 | 1-9056807 | 1:9056798 
| 2-8096 | 1-81269 1°821848 | 1-821544 | 1:8215509 | 1:8215506 
| | 4-7279 | 4:74758 | 1°746590 | 1-7466253 | 1:7466246 
| 5:2740 1°6484 1-68200 4°679808 | 1:6799182 | 1:6799139 
| 1:5739 | 1:6242 1:62008 | 1:620334 | 1:620323 
| 7°4406 1°5040 1°5734 1°56672 | 1:°567216 | 1:567186 
| 41-4383 41-5290 1°518 84 1°5197114 1°519650 
| 93499 1:3767 1°4904 1°-47590 1:-477304 | 1-477192 
1°3188 1:4569 1°4373 1:43940 1-439 207 
11-0364 14-2642 1:-4280 1-4023 1°405 39 1°405090 


y; (t) Va (t) Vs (t) ya (t) Vs (t) 

2 2 | 2 2 'p 

_ — —_ — — fas = 

1:8130 | 4:82252 | 1-822411 | 1:822416 | 1-822404 

41-6484 168197 | 1:679733 | 1:679821 | 1:6798168 
4.6038 | 4°5730 | 156616 | 1-566639 | 1:566618 

41-3767 1°4903 1-47588 | 4:477202 | 1:477183 

4-264 41-4277 1-401 98 140510  1-40480 

4-465 1-3824 4°34198 | 1°34780  1-34712 

1076 | 4:354 41-2923 1:30202  1°30069 

0-998 1-329 1:2493 1:26439  1:26208 


Table V1/10. Iterative solution with integrals evaluated by Simpson's rule with h = 0-2 


Ya (t) 


16798184 
1°477194 
1°347 187 


1:262379 
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We have y,(0)=2. Starting from the quite crude approximation y,(%) =2 
we obtain the values shown in Table VI/9 for the first five cycles of the iteration 
procedure. For the first iterate , (t) we also give the value of the integral calculated 
by Simpson’s rule (the Simpson sum), and indicate the interpolated walues by 
indenting them. 

For comparison we give in Table VI/10 the values obtained by a calculation 
performed with the double step 4=0-2. 


4.4. Power series solutions 


If the kernel K(x, €) and the inhomogeneous term /(x) are analytic 
functions of simple form, it is often convenient to calculate the solution 
y(x) for small values of x —a by means of its Taylor series 


— (a 
Ve Disnal ce a)’. (4.18) 


We will illustrate the procedure for the integral equation of the second 
kind (4.2). First we express each derivative y™(x) in terms of lower 
derivatives by repeated differentiation of (4.2); for the first two deri- 
vatives, for example, we obtain 


y'(x) = f(x) + K(x, x) y(x) y+ fee ome) (6) dE, 


cae x) 


(xe (x) —e aan + K(x, x) v(x) + (4.19) 


$ SE) (x) + * AKU) y (6) dé), 


where we have used the convention that 
aK(x,x)  (OK(x,6) | aK (x, 
ax an ( ox es — 


and 

OK(x,*) (OK (x,£) 

ms (em) 
We now put x =a in (4.2) and (4.19) and obtain a set of equations from 
which we can calculate successively the derivatives of v(x) at «=a 
which are needed in (4.18): 


y(a) = f(a), 

y"(a) = f(a) + K(a, a) y(a), 

y""(a) = f(a) + Ka, a) y'(a) + (4.20) 
+ [228 , Sete ee 
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§5. Functional equations 


Functional equations can appear in so many different forms that there would 
be little sense in setting out to describe generally applicable methods; the more 
fruitful approach here is to look at particular equations to see what methods suggest 
themselves. In any case most of the methods mentioned in §§ 1 and 2 for the 
solution of integral equations can be readily adapted for the solution of more 
general equations, and we therefore limit ourselves to a few examples. 


5.1. Examples of functional equations 


Any equation which expresses a property possessed by one or more 
functions or by a class of functions may be called a functional equation}. 
In such an equation might appear, for example, a function u(x, y), its 
partial derivatives, its values at points other than (x, y), say u(x +h, 
y-+k), integrals with integrands involving u, etc. Thus differential 
equations, integral equations, integro-differential equations, difference 
equations, in fact all the equations dealt with in this book, are functional 
equations. Sometimes, however, the term functional equation is used 
in a more restricted sense applying only to those cases in which the 
arguments of the function to be determined are not the same throughout 
the equation. If we restrict the meaning of the term in this way, we 
may, for example, refer to an equation in which the arguments of the 
unknown function are not the same throughout and in which derivatives 
of the unknown function appear as a functional-differential equation. 


We now select just a few examples from the very many different 
types of functional equation which can occur; at the same time we 
indicate possible ways of dealing with them to show that there is a 
corresponding diversity of methods for their solution. 


A very simple functional-differential equation is 


V(x) a ¥(x—1) 


(whenever there is a possibility of the argument being misread as a 
factor, as here, we write it as a subscript). Here, y(x) in the interval 
<0, 1), say, may be chosen arbitrarily from among the differentiable 
functions with y’(4) =¥(0), then y(x) in the intervals <1, 2), <2, 3), --- 
determined successively by integration in accordance with the differential 
equation. Thus further conditions are required to determine a unique 
solution. In applied problems such conditions will usually arise naturally 
in the formulation of the particular problem. For example, in the 


1 Cf. S. PINCHERLE: Encyklopadie der mathematischen Wissenschaften, Vol. II, 
Part I, 2nd half, pp. 788--817. Leipzig 1904— 1916. — Kamkxe, E.: Differential- 
gleichungen, Lésungsmethoden und Losungen, Vol. I, pp. 630—636. Leipzig 1942. 


520 VI. Integral and functional equations 


theory of structures? problems occur in which the additional conditions 
necessary to determine a unique solution of difference equations of the 
form 


Pa V(_+-(R+7) kh) = & (y =0, 1, -.5,2) 


(with given a, ,, ¢,, %, 4) are provided by certain boundary conditions; 
one then has a system of linear equations for a finite number of values 
of y, which can be solved by one of the usual methods. 


Another very simple functional equation occurs in spectroscopy. If 
the width of the slit in a spectrometer is s, the measured (known) 
energy distribution E(x) is related to the “‘true’” (required) energy 
distribution J(x) by the equation? 


d E(x) 
=] s = S\- 
ae) 


2 


This equation is solved with the aid of summation symbols?. 
A problem in kinetics leads to the difference equation4 


V(x) Pag aa Se Wes #2) = h = constant. 


The corresponding homogeneous equation, to which it can be reduced 
by putting (,,.=8,) +44, is satisfied by any trigonometric series of the 
form 
co 
Gx) = D, (4, cos nx + 5, sin n x) 


nm=1 


with a,=6,=0 for all values of » which are divisible by 3. Thus there 
are infinitely many possible “guide’’ curves. 


Another type of functional equation involves the “iterates” ¢,, (x) 
of a function y=q@(x). These are defined successively for == 1, 2 


» ary toe 


by the iterative formula @,41(x) =@(9,(%)), gi=¢(x) [for example, 
P2(x) =In Inx if y(x) =In x]. Such sequences of iterates are considered 


1 See, for instance, P. FUNK: Die linearen Differenzengleichungen und ihre 
Anwendung in der Theorie der Baukonstruktionen. Berlin 1920. — BLeErcu, F., 
and E. MELAN: Die gewohnlichen und partiellen Differenzengleichungen in der 
Baustatik. Berlin 1927. See also W. E. Mitne: Numerical calculus, 393 pp. 
Princeton 1949, in particular pp. 324 — 348. 

* MEYER-EPPLER, W.: Z. Instrumentenkunde 60, 198 (1940). 

3 See N.E. N6rtunp: Differenzenrechnung, Berlin 1924, or L. M. MILNE- 
THomson: Calculus of finite-differences, Ch. VIII, London 1933. 

4 Fiscuer, H. J.: Kurven, in denen ein Drei- oder Vieleck so herumbewegt 
werden kann, daB seine Ecken die Kurve durchlaufen. Dtsch. Math. 1, 485—498 
(1936). 
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in various contexts; for example, the repeated application of NEWTON’S 
formula for the approximate determination of a zero of an algebraic 
or transcendental equation /(x) =0 yields the iterates of the function 
p(x) =x —f(x)/f’(x). A question of interest is whether the sequence 
Y,(x) converges as m->oo, or, more precisely, for what values of x 
does it converge. Many investigations in function theory concern this 
iteration of functions, especially the case in which the functions are 
rational; these investigations are rather complicated in parts, and we 
cannot go into them here. 


Functional-differential equations arise in the analysis of control 
processes in which time-lags are taken into account. Probably the 
simplest case is that of an oscillatory system of one degree of freedom 
which is acted upon by a force P(t) whose magnitude at time ¢ depends 
on the displacement of the system at a previous time ¢—vt, where Tt 
is a constant time-lag. If x) is the displacement of the system at 
time ¢, so that P(¢) is a function of x,_,), the equation of the system 
might read 


MK + RX yy + 6 xy) = a+b xX4_2). 


More general systems give rise to equations of the form 


if rvs 


" 
pe 1b Yay) — x(t) : 

Several investigations! concern those solutions which, with their first 
n —‘ derivatives, grow no faster than some power of ¢ as |t|—> oo. The 
question of stability, i.e. what conditions on the coefficients yield systems 
for which all continuous solutions of the functional-differential equation 
remain bounded as ¢->+ 00, is particularly important for control 
processes. Again one can first remove the inhomogeneous term from 
the equation. One can then obtain an indication of the stability by 
assuming a solution of the form y(t) =e*'; this leads to a transcendental 
equation for s: 


n p 
Lo GaSe F=0. 
k=0 


r=0 


If s,,5:,-.. are the roots of this equation, then y(é = 208 eso, with 
constants c, such that the series converges, but otlrennaise atiinany, is 
i Scumipt, ErHarp: Uber eine Klasse linearer funktionaler Differentialglei- 


chungen. Math. Ann. 70, 499—524 (1911). — Hizs, E.: Lineare funktionale Dif- 
ferentialgleichungen. Math. Ann. 78, 137—170 (1918), among others. 
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also a solution; and if any one of the roots s, has a positive real 
part, then the control system is unstable. The theory of nomograms 
is often made use of in stability investigations}. 


5.2, Examples of analytic, continuous and discontinuous solutions of 
functional equations 

For many functional equations a geometrical interpretation of the 

equation can yield a graphical method for the construction of solutions. 


Example. Consider the func- 
tional equation 


y(y(x)) =g(x). (5.4) 


Thus we are required to find a 
function y(x) whose second iterate 
Y2(x) coincides with a given func- 
tion g(x). 

Let the given function g(x) be 
real and continuous, say, and 
assume for the present that 


1. g(x) > x for all x, 


2. B(x) increases monotonically 
with x. 


Fig. VI/9. Construction of solutions of the functional 
equation y[y(x)] = g(x) 


Let (%», Yo) be a point through which a curve y(x) which satisfies 
(5.1) is to pass. Then a countably finite number of points on this curve 
can be computed successively by the formula 


Xn a iy (%;,) 
(n 
Vn41 a & (X,) 


alternatively these points may be located graphically by the self-evident 
construction shown in Fig. VI/9. This sequence of points can also be 
extended ‘‘backwards” (n=—1, —2,...). It can be seen from the 
construction that if the points (%», V9) and (,, 44) are joined by any 
curve C which is not crossed more than once by each parallel to the 


1 See R.C. OLpENBoURG and H. Sartorius: Dynamik selbsttatiger Rege- 
lungen, 2nd ed., 258 pp. Munich 1951. — EncEL, F. V. A. in collaboration with 
R.C. OLDENBOURG: Mittelbare Kegler und Regelanlagen. Berlin: VDI-Verlag 
1944. — Haun, W.: Bericht iiber Differential-Differenzengleichungen mit festen 
und verdnderlichen Spannen. Jber. Dtsch. Math. Ver. 57, 55—S4 (1954). Another 
applied problem giving rise to a functional-differential equation is treated by 
C. MEIssneER (Ziirich): Bestimmung des Profils einer Seilbahn, auf der unter Mit- 
berticksichtigung des Gewichtes des Drahtseiles gleichférmige Bewegung méglich 
sein soll. Schweiz. Bauztg. 54, No. 7, 96—98 (1909). 
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co-ordinate axes, then the construction can be repeated for all points 
of this curve; in this way we can complete a particular solution of (5.1) 
for each such curve C. This procedure can still be carried out if there 
are discontinuities in the 
curve C; hence we can 
also construct discon- 
tinuous solutions of (5.4) 
in the same way. 

If g(x) possesses a 
power series expansion: 


g(x) = 28 a, 


we may expect there to 
be solutions possessing 
power series expansions: 


Asymptote 
Fig. V1/10. An analytic solution of the equation y [y(x)] =e 


V(x) — Lan Ce 


We set out to find them by substituting the assumed form of solution 
into the functional equation and equating coefficients of powers of x. 
This yields an infinite system of non-linear equations for the unknownsa, : 


Sy lea + ayayi+ apa, i+ aa, ioe 
si ay ‘+ 2a ay + 3454 4, a 
Aeon ecassasan a. aaa : (5.2) 
Ge Gg Gay 0, Gy 0 ay + 3A 943(4; + aga.) i +-:- 


Normally an approximate solution of such a system of equations 
will be determined by solving a finite system obtained from the infinite 
system by truncation, i.e. by ignoring all but the first p (say) equations 
and putting a,=0 for y=. In (5.2) the successive truncated systems 
are indicated by dotted lines. 


We now consider some specific forms for g(x). 
4. g(x) =e*. The above procedure for obtaining a power series 
solution? here yields 


1 The methods of function theory have been used to demonstrate the existence 
of an analytic solution for this case by H. Kneser: Reelle analytische Lésungen 
der Gleichung (y(x))=e* und verwandter TFunktionalgleichungen. J. Reme 
Angew. Math. 187, 56—67 (1949). Mathematicians’ attention was directed to this 
equation by its occurrence in practical industrial problems. 
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as a first approximation (fp =2) and 
y  0-4979 + 0-8781 x + 0-2618 x? 


as a second approximation (p=3). These curves can be extended for 
large |x| by means of the graphical construction (see Fig. VI/10); the 
construction shows that the solution has an asymptote parallel to the 
% axis. 


2. g(x) =1—x®. This function violates the two conditions that g(x) 
shall increase monotonically with x and always be greater than ~x. 
There are now two points 
where g(x)=x; their 
abscissae are x =&, and 
x=&,, where §& = 
$(—1 +5). No real dif- 
ferentiable solution can 
pass through the point 
x=y=f= #(— 1 +5), 
for alti nanaratian of 
the functional equation 
yields 


y'(y(x)) -9"(4) = — 2x, 


from which it follows 
that y’(&,) =/ —2&, for 
<= y =¢pe-end. thie 
value isimaginary. There 
: Fig. VI/11. Solution of the functional equation y{y(x)] = 1—x* is, however, an analytic 

solution through the 
points=y=2,= —2(1 +75), and for this solution we can assume a 
power series expansion; for the second approximation (a,=0 for > 2) 
(5.2) reduces to three equations, which with gy=1, g,=0, g,=—1 
lead to the quartic a{(aj+2a,)=4 for a, and thence to the two real 
approximations 


yr 0-648 + 1-090x% — 0-842 x?, 
y & — 6-244 — 2-320x% — 0-186 x2. 


Another way of obtaining a sie! series solution is to calculate the 
derivatives of y(x) at the point x =é, from repeated differentiations of 
the equation and then write down the Taylor series for y(x) at x =é,. 
Thus we have 


ar 4 2 , Mt — — 5) ur —2 
yy) [y"(x) ]? + y'(y) y""(x) = —2, so that y"(Es) = - y'(G) (t+) ° 


5.3. Example of a functional-differential equation from ‘mechanics 525. 


similarly 


mr ies (y’’(&s)]* 
and we obtain 


y = E,-+ 1-799 (x — &,) — 0-1986 (x — &,)* — 00187(% — &)*+---. 


The curve corresponding to this solution is shown in Fig. VI/11, where 
the initial part calculated from the power series has been continued by 
means of the graphical construction. Once inside the square OS (4%, y) S14, 
the curve cannot get out again and “‘inscribes’’ it an infinite number 
of times, clinging more and more closely to the sides of the square with 
each revolution. 


5.3. Example of a functional-differential equation from mechanics 


Consider the small oscillations of a mechanical system consisting of a homo- 
geneous string of length / fixed at one end x =/ and attached at the other x=0 
to the centre of a transversely mounted 
spring as in Fig. VI/12. 

The displacement of the string %(¥, 2) 
at the point x at time # satisfies the wave 
equation 


Cru : Cu 


ya 2 ax%? (5.3) 


where C is a given constant. A displace- 4 

ment (0, f)=w4,(t) at the point +=—0 Fig. VI/12. A non-linear oscillatory system 
produces an opposing force H(ug) in the 

spring, H(u) being a given, in general non-linear, function of u; we will assume 
also that H(u) is an odd function of u. The boundary conditions therefore read 


ou(O,t) 
a ec G (u(0,#)), (5.4) 
u(i,t) =0, 


where G(u) =kH(u) is likewise a given, non-linear, odd function of u (Rk is a 
constant depending on the tension in the string). Our object is to investigate 
solutions which are periodic in time; the period T will depend on the maximum 
displacement. Let us look for a solution which passes through the position of 
equilibrium at time ¢=0, say, i.e. a solution for which 


u(*,0)=0 for OS*Sl. (5.5) 
Now the general solution of (5.3) can be expressed in the form 
u=f(x+Ct)—e(x—Ch), 
where f and g are arbitrary functions. The initial condition (5.5) then becomes 
f(s) =e(*) for OS%S], 


and since the values of f(x) for x< 0 and of g(*) for x>/ do not affect the solution 
for {> 0, which is what interests us, we can put f(x) =¢(*) for all x. The boundary 
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conditions (5.4) then reduce to 
Ay) fC — 9), (5.6) 
PO == 9) = GUO 1(—9)), 27) 
where y=C 7. 
It remains to express the condition of periodicity in terms of /: we require that 


Pe mie — *) 


for some real finite number t; then /(*) will have the period 27 and u(x, ft), as a 
function of t, the period T = 22/C. 

Thus for given G(u) we seek periodic solutions of the functional-differential 
equation (5.7) which are symmetric about the point *=/. 

A simple way of obtaining a solution of this problem is to choose a value for 
the period 2t and determine a solution of (5.7) with this period, say by the finite- 


2 0 y 6 & «uu 
Fig. VI/13. Notation for the finite-difference solution of the Fig. V1/14. Solution of the transcendental 
functional equation equations 


difference method; naturally for given G(u) there may be values of 21 for which 
no solution exists. 

We illustrate the procedure with /= 1, and choose first 2r = 3. We need only 
consider a half-cycle, and if we divide this interval into three, i.e. use a finite- 
difference step h=41=4, we have four unknown f values a, b, c,d as indicated 
in Fig. VI/13. The finite-difference equations read 


(for + =} d—b=G(c—a), or B=G(a), 
(for x = 1) c—e=G(d—0), or o=G(p) 


(no new equations are obtained for x = $ and x= 2); the « and p introduced here 
are corresponding values of (0, ?): 


anc—a=i(>)—¢(-2)=u(o,7], p=d—b=s(1)—4(-1) =u(0, 2). 


For a normal spring G(u) is monotonic, and the values of « and B are given by 
the intersections of the curve v=G(u) with the straight line v= (Fig. VI/14). 


Let us now choose another period, say 2t= §, and this time use more pivotal 
points, say with h=4t=4. We now have five unknown f values a, b,c, d, e 


(as in Fig. VI/13) and three corresponding values of (0, f): (o. a f ( : } — 


{(—+)=e—a=, u(o, 2 |=a—0=4, u(o, E)-e-e= = Uf wesput 
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G*=2hG = 3G, the difference equations read 


(for x= }) d=6*(y), 
(for x=§) = y Le=G*(d), 
(for 7 = 4) 6 = G*(e) 


(no new equations are obtained for x= 4, §,...). 


If G(w) is monotonic, we must have y= e and the equations simplify to the 
pair of equations 
DSGAY) AVEC A 


These also may easily be solved graphically [see Fig. VI/14; in this sketch, which 
is only for illustration, we have not drawn a new curve for G*(u)]. 


5.4. Miscellaneous exercises on Chapter VI 


4. Consider a luminous, line “object’’ whose intensity of illumination is a 
function z(&) of the distance € along the line, and let its image formed by an optical 
system (Fig. VI/15) be another line, say the » axis, illuminated with the intensity 
y (x); further let all parts of the lines 
outside of the sections |¥|<1 and 
|€| <1 be shielded by blinds. Then 


é 


the intensity distributions y(%) for Binds 
|*| <1 and 2z(&) for |&|<1 are related 
by an integral equation! of the form 
—_——_— ' Z 
1 4) (Y 7 
y (x) = f K(x, &) 2(&) 2é; Fig. VI/15. Optical system with line object and image 


Sl 


the kernel K(x, &) depends on the optical system used, but may be approxi- 
mated by 
1+cosa(x¥—&) for |*—&|S1, 


Kis.8) = {0 for |*x—&|21. 


For what intensity distributions are the object and image distributions similar, 
ie. such that z(x)=Ay(x)? Calculate approximations for the first few eigen- 
functions by the finite-sum method of § 1.2. 


2. Apply the enclosure theorem (2.15), (2.16) of § 2.3 to the integral equation 
1 
y (x) = Af exFy(E) d€. 
0 


3. Determine an approximate solution of the non-linear integral equation 


f a 
y(a) +9) 
0 


by the finite-sum method of § 1.2. May the Ritz method of § 1.7 also be applied 
to this equation ? 


i FRANK, Pu., and R. v. Mises: Die Differential- und Integralgleichungen der 
Mechanik und Physik, Vol. I, p. 473. Brunswick 1930. 
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4. Determine a real analytic solution of the functional equation 


Het y(qy=t— 
(where the argument is again written as a subscript so that it cannot be read as 
a factor) under the assumption that such a solution exists. 
5. Use the finite-difference method to obtain approximate solutions of the 
eigenvalue problem presented by the functional-differential equation 
Me) =A¥a—a 
with the boundary conditions 
¥(0) = 9/(1) =0. 
6. Apply (a) the Ritz method and (b) the power series method to the problem 
of the last exercise. 
7. Let us end by applying the two well-tried methods 
(a) the finite-difference method 
(b) the Ritz method, 
which have been used repeatedly throughout this book, to the partial functional- 
differential eigenvalue problem 
V2u(4%, 9) of Au(— %, —¥) =0 
with the boundary conditions 


u=0 for *=1 and for y=1, 
cane G for *=—1 and for y=—+1. 
ov 


Calculate approximations for the first few eigenvalues. 


5.5. Solutions 


1. (a) Three pivotal points 4;=7 with 7=0, +1. Let y; be the approximate 
pivotal value of y(%) at x= *;. We must remember that there are discontinuities 
in the derivatives of the kernel and, as mentioned in § 1.2, must choose our qua- 
drature formulae accordingly; if we evaluate the integral by the trapezium rule 
for x= +1 and by Simpson’s rule for *=0, we obtain from the equations 


Y-3r=AY4, W=ABByH, YW=AS, 
the three approximate values 
A=#F,1,1 
for the eigenvalue A. 

(b) Five pivotal points *4j=47 with 7=0, +1, +2. As usual with symmetric 
eigenvalue problems we can reduce the number of unknowns by treating the 
symmetric and antisymmetric solutions separately; thus if y; iS an approximation 
for y(%;), we postulate Jj= v_; for symmetric solutions and jee y_¢ formaniti= 
symmetric. For the symmetric solutions we obtain the equations 


A 
(2¥,+ 4%), 


io a 
A 3 

Sy cary (Ye+ 69, + 34%), 
A 

o— 6 (84 + 4 V9) 
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(it is a help in setting them up to record the values of the kernel K(x, é) in an 
array as in Fig. VI/16); we have taken account of the points at which the kernel 
has discontinuous higher derivatives by using SImpson’s rule for ¥ = 0, 1 and the 
“three-eighths” rule for ¥ = 4. 


For «= 1/A we obtain the equation 
~ 2418 + 51x8@— Sx —2=0, 


which yields the approximate eigenvalues 
A=0°541, 2:53, —873. 


By postulating antisymmetry we obtain 
similarly 


4 
x= = (35 + 649); A=0-794, 5-04. Fig. VI/16. Values of the kernel 


The points given by the corresponding solutions of the homogeneous equations 
are plotted in Fig. VI/17 and joined by straight lines, so that the approximate 
eigenfunctions are represented by piecewise-linear functions; smooth approxi- 
mations could be obtained by rounding off 


the corners. ¥ 
: u : A = 0541 
2. An obvious choice for Fg(*) is e**; 
then 
il 
eatz— 4 
= Eee é dE = ——___ 
Ra) = f ertertag = 


6 
and 
F(x) _ #(a +2) 
F(x) ett*—1 


D(x) = 


Curves of ®(%) against * are drawn in 
Fig. V1/18 for several values of a; the 
difference ®,,,,— Pin appears to be smallest 
for a value of a about 0:59; for this value we 
obtain the limits 


Dyin = 0°7338 S AS07417 = Dax. 


The mean value, which can be in error by 
Fig. VI/17. Approximations obtained by the 


9 : ‘ 
at most 0:°53%, ada Aw0 7377. summation method for distributions of 
At the same time F,(7) with a=0-59 illumination which undergo pure magnifica- 


provides an approximation for the corre- tion in an optical system 
sponding eigenfunction. 

3. (a) First of all let us find a very crude approximation by taking only two 
pivotal points x =0 and ¥=1 and using the trapezium rule; then for yp) and j,, 
the approximate values of y(0) and y(1), we obtain the equations 


‘ 
: weg | ey — ee 


2H YWtn " Yt  2n 


Collatz, Numerical treatment, 3rd edit., 2nd print. 34 
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These yield a quadratic for the ratio 7 = y,/y9, from which we calculate the two 
values 


0°2808 
— 1°7808; 


Vy 3 1 { 
= oS — — ¥17 = 
ESP qng lt 


we therefore obtain two solutions (8 y)= 4 + 17, 169;= 7 V17): 
1st solution: 4» = 0-640, Y, = 0°180 
2nd solution: yy = — 0-390, y,= 0-695. 


For the second solution, which changes sign, the integral equation is singular 
and the integral must be regarded as a Cauchy principal value (cf. § 3.2); con- 


0 02 OF 06 08 7 


I 


Fig. VI/i8. A family of functions (x) from which is to be chosen the one with smallest variation 


sequently, indiscriminate use of the finite-sum method should not be carried any 
further in this case, and we will proceed to higher accuracy only for the solution 
with constant sign. 


(b) Let 49, 44, %, be approximations for y(0), y(4), y(1). Evaluating the 
integral by Simpson’s rule we obtain 


1 4 1 ne 
2Vo Yo+ Yo+ Va , 
1 4 1 
a a SRS See = 9, 
Yor Wy 2y, 1+ Ve 
1 4 1 
= 12. 


Yot Vo Wt Vs ais 


If we write a= 9+ 4,, b=, C=3¥,+4g, we have a system of non-linear 
equations for a, b,c for which an iterative solution is suitable; thus we calculate 
the (m+ 1)-th approximation a,41, 6441, y+, from the m-th by the formulae 


4 1 1 
cn 7 2 (an — by) i Gn + Cy— 2b, 

2 oe (n = 0, 4,2, +.) 
On+y anti fn aoe 
phat i 1 


Cnty Anayt a 2bn 4) 2 (Cy — bn 41) 
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This iteration converges well, and yields the values 
@2=0:990, 6=0:332, c=0°505, 
from which we obtain the approximate solution 
Y= 0°658, 9, = 0332, y.= 0-173. 


(c) In Ritz’s method we have to find approximate solutions of the variational 
problem 


11 1 
Jiu) =F f fin(u(x) + u(&))dxd& — f (1 + x) u(x) dx = extremum. 
0 


In the first approximation with u=a we have J=21n 2a—#a, and dJ/da=0 
yields the value a = 4; however, even for the second approximation with u=a-+bx 
the amount of calculation involved is already disproportionately large in com- 
parison with the finite-sum method. 


4. (a) Let us see first whether y(x) can vanish at some point x= &; if, for the 
present, we consider only single-valued solutions, the functional equation at such 
a point would read 0 = 1 — &, so that we must have = +1. Let us now determine 
the derivatives at €=+41 of the solutions which vanish at these points. By 
repeated differentiation of the functional equation we obtain 


W(x4-y(2)) 1 + 9(*)] = — 24, 
V(x+-y(2)) (1 + y’(%)]? + y’"(#) V(x y(2)) =—2; 
now for x=€= + 1 and y(é) = 0 the first equation reduces to a quadratic for y’(é): 
[y"(E) PP + »’(E) + 26 =0; 


since this has real solutions only when = — 4 we need no longer consider the 
point =1. For = —1 we have y’(&) =1 or — 2, and for each of these two values 
the higher derivatives at = —1 are determined uniquely. To calculate the two 


solutions y,(*), y,(¥) through the point (— 1, 0) we put ++ 1=u and insert the 
power series 


lee} 
W(-144) = Dy a,u” 
v=] 
into the functional equation, which then reads 


V-14u+yl—14u)) = 24 — 0; 


for a, = — 2 and a,=1 we obtain the respective expansions 
2 1 
Vi(—-14+4)= — 244+ 4 — Foes = ut — ++, 


AD sald 


5 4 
225 “ ~ 3825 ” 


i a 
¥q(—1+u) = 4 — 5 1 eco =, 
(b) To pursue the solution y,(#) further, let us calculate sequences of points 
(¥;, ¥;) from the equations 


R= yt, War=1—aP (7 = 0, 1,2,...) 


with %»=0 and yp as a parameter; we choose several values of 1) covering a range 

in which we expect to find the value associated with 4, (¥). Each of these sequences 

lies on a solution of the functional equation, and as can be seen in Fig. V1/19, which 

shows several points of the sequences for y)>= — 1:4, — 1:38, — 1:397, these curves 
34* 
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ty 
+ -~ 
Qa 
ae Abints for Uy =-14¥ 
-o0--~o- = * YW =-1377 
oo ” » Yo = 7B 
-a5 + 
| 
NN 
v 
! 
‘\ -7 + 
Fig. VI/19. 


Solution of the functional equation (24 y (x)= 1—+* 


~¢¥ i 
Fig. VI/20. A many-valued solution of the functional equation 


diverge in varying degrees either side; by interpolation the initial value correspond- 
ing to the non-diverging curve is found to be yy= — 1:39635. 


(c) By continuing the solution y,(7) by means of the functional equation we 
obtain a many-valued function; a part of it is reproduced in Fig. VI/20. 
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5. With the pivotal value notation a, b, c as in Fig. VI/21 and A as an approxi- 
mate value of A the finite-difference equations read 
9(b — 2a) + Ab=9(c — 26+ a) 4+ Aa=9(2b — 2c) =0, 


and for non-trivial solutions we must have A=9(—1+ )2)- These values are 
expressed in decimals in Table VI/11, together with the values obtained for h=4 
and h=}. 


Table VI/11. Successive approximations for the 


eigenvalues 
inert | 4+ | ae | a | 
i 
Fig. VI/21. Pivotal value notation for the eis: = onl an 
functional-differential eigenvalue problem a Beer, | fee 
h=% | —87-25}) —22-29| 3-591 | 56-0 


The problem possesses infinitely many positive and infinitely many negative 
eigenvalues. 


6. (a) The corresponding variational problem reads 
as 
J(u) = f (ud, — Aug ta—] d% = extremum 
0 


with respect to the domain of functions w possessing continuous derivatives and 
satisfying the condition «(0)=0. Thus if we put uw=y-+en, where 7(0) =O, 
in J[u], the condition (0 J/Ge),.9, which is necessary if y is to minimize J, leads to 


1 
Sn (#) {= va) — Ava-nh4dx+ [ny JG=0 
0 


on integration by parts, and the usual arguments show that y, which already 
satisfies y(0) =0, must also satisfy the functional-differential equation and the 
boundary condition y’(1) = 0. 

Let us use the two-parameter Ritz expression 


u=C, (24%—+%*) +¢,(34—+%), 
which satisfies both boundary conditions [wneed only satisfy the condition “(0) = 0, 


but here it is no more difficult to satisfy the other boundary condition at the 


same time]. 
The necessary conditions 6J/éc, = @J/éc, = 0 yield two homogeneous linear 
equations for the Cy; their determinant 


4 41 5 2 
ny ea ae ee 
3 A 30 2 3 
5 =A 2 24 =A 169 
2 3 § 140 
vanishes for the values 
{ 3°51984 
A= 
— 23-346. 


10) 
A one-parameter expression (c,= 0) would have lead to the value A= - FY 3636, 


while for a two-parameter expression satisfying the boundary condition u(0) =0 
only, i.e. w=c,%-+¢,%*, we would have obtained the values 


37555 


A= Sea Ee 
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(b) At the point x=1 we have y’(1)=0, and from the functional equation 
y’’(1) = —A¥y(0)=0. We therefore assume the power series solution 
Ya—z) = % + ag 43+ a, x4+ asx... 
By inserting the series in the functional equation and equating coefficients 
we obtain an infinite system of equations for the a;; with 1=20y they read 
Ay t Ggt Gt gt agt--'=0, 
10 ay + 343+ 644+ 104,+ 15a,+---=0, 
ag+ 4a,+ 10a,+ 20a,+---=0, 
4+ 54,+ 154,4+°--=0, 
areins “Po Gg (Omg = 0, 


Apart from a missing line and the terms involv- 
ing uw, the coefficients are binomial coefficients. 
If we truncate the system by retaining only 
the first five equations and putting a;=0 for 
7=7, the zeros of the truncated determinant 
yield the approximate eigenvalues 
3°5208 


A=—(—5+)%45) ={_ 33 


7. (a) For the pivotal interval h=#% and 
with pivotal values a, b, ..., f as in Fig. VI/22 
for solutions symmetrical about the diagonal D, 
the finite-difference equations read 


—4a4 2b+ uc =0, 
a (e— 4) “Ghee =0, 
feat 2b — +e Hae =0, 
2b —4d= @ =0, 


2c + ad a 4e ie f =0 , 
Fig. VI/22. An eigenvalue problem for 
a partial functional-differential equation 4e—4f=0, 


where u=A h? and A is an approximate value of /. 


For y= $u we obtain the equation 11¥3— 19¥*— 41»+ 26=0, which yields 
— 1-580, (A= — 7-44, 
y= 054100, and hence {4 = 2-434, 
27659, Asa—) 42:45; 


the cigenfunction corresponding to 1, is depicted in Fig. V1/22. The value obtained 
for 4, by the simpler calculation with h=1 is A,= 8 = 2-667. 

A corresponding calculation (with = 2%) for the antisymmetric solutions (cf. 
Fig. VI/22) yields A_,= — 7°8. 

(b) A corresponding variational problem reads 


JT?) =a [py + oy — Ap(x,¥) p(— %, — y)]dxdy = extremum 


with (1, y)=@(%, 1) =0; Q is the square |%|<1, |y| <1. 


5.5. Solutions yo 52S) 


This can be verified in the usual way by putting p=u+ én, where (1, y) = 
n(%, 1) =0, and calculating 


(ca en) i 


= i [2 (¢z%x+ Uy Ny) — A{u(x, y)4(—¥, —y) + u(~ 4, — 9) n(x, y)}]dxdy. 


To find the conditions on % necessary for this expression to be zero for any 7 we 
transform the first term by GREEN’s formula (3.7) of Ch. I: 


iy (UeNet UyNy) axdy = — ey ld 
oi 


and change the signs of x and y in the term in 7(— x, — y), obtaining the necessary 
condition 

Sf nViu(x, y) +Au(— x, —y)}dxdy+ fnu,ds=o. 

Q ip 


By the usual arguments we deduce from the arbitrariness of 7 that the factor 
multiplying 7 in the double integral must vanish, i.e. « must satisfy the functional 
equation, and that on the part of the boundary where we have not required that 
” = 0 the normal derivative u, must also vanish, so that u must also satisfy all the 
given boundary conditions. 


Let us now assume for @ the expression 
Vay — 9) (8 1 x)8 2-9) 
(non-linear in the parameter f). Then J takes the form J =/,(f8)—Af,(B). In 


the usual way ey =f;—Af,=0 yields at the same time the value A = : 
o 7 f, /extr. 
from (2) = fils hfe = 0 it follows that 1. — A . Here 
3 fi fp fe 
(7 — 6B + 3B?) (2— 5B + 58?) 
A=10~ Ta age 
espa 


and from a graph we find that the approximate position of the minimum is at the 
point 6 = 2 and the corresponding approximate value for A, is A = 2-326. 


Appendix 


Table Il. Approximate methods for ordinary differential equations of the first order 


y= (4, 9) 
Notation: y,= approximation for y(*,); f,= f (#5, Vs) 
(Explanations in the text of Chapter IT) 


Formulae of Runge-Kutta type 


1st order 
(polygon method)| ¥7+1= Yr +h 
1 
2nd order tiga tla: Mts hi,); Vr4i= Vet hits 
(improved Se 
polygon method) | y# —y,+hhs  Yia= et = Alife t+ feta Yo4a)) 
eee. eel. 
A= hii By BiH 4 4. Het ZA) 
1 
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Table II. Approximate methods for ordinary differential equations of the second order 
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Notation: y,, y; approximations for yas), y (%,), resp.; [= (4,5, Vo, ys). (When 
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equation of the first order). 
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1 MILNE, W. E.: Amer. Math. Monthly 40, 322 — 327 (1933). — Hartree, D. R.: 
Mem. Manchester 76, 91—107 (1932). 
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Table III. Finite-difference expressions for ordinary differential equations 


(Notation: 7j=y(7h), 9 =9'(7h), etc.] 
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Table III (continued) 
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(Notation: y;=y(jh), yj =y' (7A), etc.) 
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The next non-vanishing 
term of the Taylor 
expansion 
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Table IV. Euler expressions for functions of one independent variable 


(To facilitate the setting up of variational problems corresponding to given ordinary 
differential equations.) 
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Table V. Euler expressions for functions of two independent variables 


(To facilitate the setting up of variational problems corresponding to given partial 
differential equations.) 
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— formulae 72, 81, 118, 316, 469 (See 
also under CHEBYSHEV, EULER- 
Macraurin, Gauss, Integration, 
Simpson, Three-eighths rule, Tra- 
pezium rule) 

Quasi-linear differential equation 6, 306, 

308, 319 


Radial stress 251 
Rail, elastically mounted, 152, 219 
Railway track mountings 493 
RAYLEIGH’S minimum principle 239 
— quotient 230 
Rayleigh-Ritz method 248 (See also 
Ritz method) 
Rectangular mesh 263, 343 
— plate 434 
Recursion formula 225, 261 
Recursive error estimates 59—61, 101, 
(3378. 
— solution of systems of linear equa- 
tions 144, 150, 153 
— — — — of non-linear equations 
146 
Reduced system of finite-difference 
equations 372 
Reduction to boundary-value problem 
136, 333 
— to coarser mesh 374 
— to explicit differential equation 
96—7 
— to initial-value problem 77, 184 
— to ordinary differential equations 
265, 305, 439, 440 
— to plane problem 369, 452 
Regular integral equation 467 
Relaxation 30, 42, 154, 360 
— and monotonic problems 42 
— with error estimation 42, 364 
Repeated integration 11—7, 52 
Residuals 30, 42, 154, 361 
Response of a linear system 514 
Rigorous error limits 51, 102 (See also 
Error estimates) 
Ritz approximation 207 


— —, mixed, 438 

— method 202, 241, 245, 252—3, 400, 
425 et seq., 441, 444, 453, 
484—9, 527—8 


— —, mixed, 273, 438 


Rod, steady temperature distribution 
in, 150, 159, 182 

—, unsteady heat flow in, 267, 281, 293, 
665-5 

Rotating disc 251 

Rounding error 50, 57, 102, 112, 267 

— off 267 

Row-sum checks 269, 276, 280, 294, 326, 
339, 341 

— criterion, ordinary, 45, 46 

— —, weak, 45, 46, 173—5, 348 

Runge-Kutta method 50, 57, 61—78, 80, 

94, 118, 137, 138 
— —, stability of, 112 


Schwarz constants 231, 479 

— quotients 231, 479 

SCHWARZ’s inequality 27, 114 

Self-adjoint differential equations 208, 

216, 228, 435, 446 

— eigenvalue problems 229 

Semi-ordered space 38, 42 

Separable differential equation 403 

Series expansion 222, 418, 451, 492 (See 
also Eigenfunction expansion, Power 
series) 

Shear stress 358, 453 

Simpson’s rule 11, 87, 316, 470, 474, 477, 
516, 528, 529, 530 

Single-step iteration 46, 173, 348, 367, 
378 

Single-term class of eigenvalue problems 
236, 246 

Singular integral equation 468, 504—12 

— kernel 504 

— point 208, 439 

Singularities, treatment of, 253, 275, 
279, 286, 357, 380, $08 

Smoothing of irregularities 90, 94 

— of kernels 504 

— procedure 91, 94, 424 

Solving kernel 500 

Sound waves 452 

Spatial problems 368 

Special eigenvalue problems 228, 232, 
234, 237, 240, 243 

Spectrometer 520 

Spectroscopy 520 

Square cross-section 403, 410, 423, 447 

— mesh 263 

— plate 359, 361, 421, 431 

— wire 410 
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Square-integrable 502 
Stability condition 302, 305 
— in control systems 521 
— of difference equations 268—276, 
287—8, 301—5, 335 
Starting iteration 81, 99, 103, 109, 118 
to 123 
— values 79—82, 117—123 
Steam turbine rotor 251 
Stencils for finite-difference formulae 
373, 390 
Step 7, 53 
— function, unit, 514 
— index 71, 89 
— length 53, 79 
~—— —, change of, 78, 89 
= =, CNGNAA OH, Wal, Wis, CP, SS, ey 
129 
— —, natural, 89 
Step-by-step integration 50 
— methods for integral equations 513 
STIRLING’S interpolation formula 8 et 
seq., 86 
STORMER’s extrapolation method 125, 129 
Stream function 355 
Streamlines 355 
Stress distribution 251, 435 
— function 357, 454 
String, vibrations of, 252, 261, 525 
Strip conditions 307 
— manifold 307 
Structures, theory of, 520 
Strut (see under Bending) 
STURM’S boundary conditions 4 
Sub-harmonic function, discrete, 365 
Sub-sets of mesh points 267, 373 
Successive approximations, method of, 
189, 502, 516 (See also Iteration) 
Summation method 53 
— symbols 520 
Suppressible boundary conditions 4, 
206, 216 
Suspension bridge 492 
Symmetric kernels 470, 502 
— modes of vibration 258, 392 
— systems of finite-difference equa- 
tions 174 
Symmetry property of distance 34 
Systematic relaxation procedures 367 
Systems of Euler equations 439 
— of ordinary differential equations 
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Taylor series expansion 62 et seq., 80, 
118, 161 et seq., 287 et seq., 310, 320, 
336, 349, 370, 376 et seq., 518, 524 

TAYLuR’s formula 19 

— theorem 20, 47, 160 

Temperature distribution (steady) 

— — — ina cube 368, 437 

— — — in a cylinder (circular) 452 

—- (elliptical) 471 

— — — inarod 150, 159, 182 

— — — ina square plate 361, 453 

— — — in a wire 381, 387, 405, 411 

to 414, 419, 429 

TEMPLE’S quotient 246 

Terminal check 52, 72—3 

Three-dimensional problems 284, 368, 
437 

Three-eighths rule 474 

Time lag 521 

Tolerance 349 

Top equations 75 

Torsion problems 403, 422, 445, 447, 451 

Total-step iteration 46, 173, 348, 373 

Transformation 35, 192 (See also Opera- 

tor) 

—, linear 514 

— of a differential equation 96, 117, 

137, 208 

Transformer field 451 

Transforms, Fourier, 369 

—, integral, 369 

—, Laplace, 273, 369 

Transient current 335 

Transmission system 514 

Transonic region 286 

Trapezium rule 61, 469 et seq. 

Trapezoidal plate 391, 453 

TREFFTz’s equations 443 

— method 404, 441 

Triangular inequality 34 

— mesh 389 

Tricomi equation 263, 286, 329 

Trigonometric interpolation polyno- 

mials 83 

— series 371, 423, 492, 506, 520 

Trivial solution 5 

True value 57 

Truncation error 57, 103, 109, 117, 164, 
270 

Two-dimensional unsteady heat flow 

284, 335 
— wave equation 335 
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Undisturbed differential equation 187 

Unevenness 90, 94, 1114 

Uniqueness of fixed points 38 

— of periodic solution 199 

— of solution of difference equations 
173, 348 

— — — of initial-value problem 114, 
307 

— — — of integral equation 512 

— theorem for power series 225 

Unit step function 514 

Unsymmetric finite-difference formulae 

168, 170, 172, 312, 315 
— kernel 472 
— point pattern 346 


Vandermonde determinant 162 
Variation equations for the finite-dif- 
ference methods 111, 135 
Variational calculus 202 
— problems (see Least-squares, R11z’s 
method) 


Vibrations, acoustic, 452 

— of a beam 303 

— of a cantilever (longitudinal) 147, 
163, 210, 235, 237, 248 

— — — — (transverse) 253 

— of a hexagonal plate 395 

— of a membrane 278, 392, 453 

— of a string 252, 261, 525 

VoLTERRA’s integral equation 468, 

512—8 


Wave equation 277, 279, 295—6, 335, 
525 

— velocity 279 

Waves, acoustic, 452 

Weak Lipschitz condition 113 

— row-sum_criterion 45—6, 173—5, 
348 

Weighting functions 30 

Wing theory 512 
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